In short
Our client is a large global integrator. They are seeking a Data Engineer.
SQLAWSSPARK
π About the job
π’Overview
Our client is a large global integrator. They are seeking a
Data Engineer.
In this role you will design, develop, and optimize secure, scalable enterprise data solutions supporting the modernization and cloud migration of their background investigation system, leveraging AWS data platforms, modern data architectures, and advanced ETL/ELT technologies.
Per our Federal Government Contract, candidates must be
U.S. Citizens with an ACTIVE TOP SECRET CLEARANCE.
β Responsibilities
β Design scalable, secure, and high-performance database architectures to support Mirador modernization.
β Define data models and storage strategies that align with cloud migration objectives.
β Optimize performance, availability, and disaster recovery across environments.
β Collaborate with the client team to identify data requirements for user stories and update the unified data model.
β Leverage the data lake to capture functionality-specific data.
β Ensure compliance with data governance, security, and data retention policies.
β Document database designs, configurations, and operational procedures.
πQualifications
πΉActive Top Secret (TS) clearance or TS eligibility, with the ability to complete adjudication/transfer requirements, and a Security+ certification required on day one.
πΉ7+ years of experience designing, developing, and supporting enterprise data engineering solutions and modern data platforms.
πΉStrong expertise in relational databases, including PostgreSQL, Oracle, and SQL Server, with experience integrating semi-structured and NoSQL data sources, such as DynamoDB, JSON, and APIs.
πΉExtensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting.
πΉHands-on experience with Amazon Redshift.
πΉHands-on experience developing scalable ETL/ELT pipelines using AWS Glue, Apache Spark/PySpark, SQL, and Python.
πΉExperience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as Amazon Redshift.
πΉStrong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, and Secrets Manager.
πΉExperience designing metadata-driven ingestion frameworks, data lineage solutions, and data quality validation processes.
πΉProficiency in data modeling, schema evolution, data versioning, and master/reference data management.