Data Engineer --- Malvern PA

Location: Malvern PA

10+/12+ Yrs of Experience

Day 1 onsite and then Hybrid

Job Description

Proficiency in languages like Python and some understanding of R.

Proficiency in Bigdata frameworks for processing large datasets and building data pipelines.

Hadoop, Apache Spark using PySpark or Scala, Hive/Presto, Hue etc.

Expertise in handling structured/unstructured data with an understanding of distributed computing and distributed storage

Cloud Computing - Strong knowledge and hands on experience working with cloud platforms like AWS Analytical and Storage services

AWS S3, EMR, EC2, Cloud formation, IAM, KMS, Athena, SageMaker, Glue, VPN, CloudWatch etc.

Knowledge of databases, data warehousing solutions and data lakes.

Feature Engineering

Data Visualization skills using python libraries.

Job workflow orchestration

Knowledge of various Client algorithms