In short
Our client is a large global integrator. They are seeking a Data Engineer.
SQLAWSSPARK
๐ About the job
๐ขOverview
Our client is a large global integrator. They are seeking a
Data Engineer.
In this role you will design, develop, and optimize secure, scalable enterprise data solutions supporting the modernization and cloud migration of their background investigation system, leveraging AWS data platforms, modern data architectures, and advanced ETL/ELT technologies.
Per our Federal Government Contract, candidates must be
U.S. Citizens with an ACTIVE TOP SECRET CLEARANCE.
โ Responsibilities
โ Design scalable, secure, and high-performance database architectures to support Mirador modernization.
โ Define data models and storage strategies that align with cloud migration objectives.
โ Optimize performance, availability, and disaster recovery across environments.
โ Collaborate with the client team to identify data requirements for user stories and update the unified data model.
โ Leverage the data lake to capture functionality-specific data.
โ Ensure compliance with data governance, security, and data retention policies.
โ Document database designs, configurations, and operational procedures.
๐Qualifications
๐นActive Top Secret (TS) clearance or TS eligibility, with the ability to complete adjudication/transfer requirements, and a Security+ certification required on day one.
๐น7+ years of experience designing, developing, and supporting enterprise data engineering solutions and modern data platforms.
๐นStrong expertise in relational databases, including PostgreSQL, Oracle, and SQL Server, with experience integrating semi-structured and NoSQL data sources, such as DynamoDB, JSON, and APIs.
๐นExtensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting.
๐นHands-on experience with Amazon Redshift.
๐นHands-on experience developing scalable ETL/ELT pipelines using AWS Glue, Apache Spark/PySpark, SQL, and Python.
๐นExperience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as Amazon Redshift.
๐นStrong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, and Secrets Manager.
๐นExperience designing metadata-driven ingestion frameworks, data lineage solutions, and data quality validation processes.
๐นProficiency in data modeling, schema evolution, data versioning, and master/reference data management.