Role: Big Data Architect

Location: Weehawken NJ (Hybrid)

Type: W2 or 1099 - NO C2C

We're looking for Big Data / DataBricks Software Engineer - Finance Reporting to:

provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services

work with our Finance Reporting team to translate business needs using Behavior Driven Development (BDD) into functional requirements. Key to ensuring a successful partnership will be the ability to understand the business impact, the underlying data requirements and calculations so that we ensure appropriate challenge and support.

document key artefacts including functional specifications (with data/field/table specific information and clear rulesets), process flow documents, test strategy, test requirements and detailed task level plans (working with the scrum master to baseline).

data model our Business requirements to ensure efficient design, data lineage, ownership and control

design, plan and deliver sustainable solutions using modern programming languages

provide technical expertise and recommendations in assessing new software projects and initiatives to support and enhance our existing applications

Your expertise

software engineer/developer focused on developing reporting solutions within the finance sector

intermediate understanding of Big Data tech: Spark / Databricks / Hadoop

intermediate+ experience with Scala, Java (Spring), Python, SQL

Cloud experience (Azure preferred). Specifically developing front to back cloud native solutions using Azure offerings (IaaS, PaaS, or containerized AKS deployments)

experience in DevOps (Azure Devops, Gitlab CI/CD, IaC, Automating deployment, job scheduling, build chain)

excellent communication skills and ability to work within a team environment

strong experience in the Unix environment including shell scripting

strong experience with data warehousing (Hands on SQL)

familiar with SDLC and software development best practices, including version control

Experience with Agile Methodology, Scrum Methodology and BDD

design, plan and deliver solutions in a large scale enterprise environment

Bachelor's/Master's degree or equivalent with a focus in computer science or engineering