Principal Data Engineer -53328
Principal Data Engineer -53328 We have an immediate long-term opportunity with one of our largest clients for a position of Principal Data Engineer, to work in Bellevue WA
Responsibilities:
Utilize Azure services including ADF for orchestration, ADLS for storage, and AzureDevOps for CI/CD. Design, develop, and maintain ETL processes leveraging Databricks and Spark. Write and maintain PowerShell scripts for automation tasks. Utilize SQL (TSQL, PostgreSQL) for data manipulation and querying. Work with parquet and delta formats for efficient data storage and processing. Follow SDLC and CI/CD practices, including peer-reviewed code deployments. Optimize code for performance, including understanding indexes, partitioning, and resource utilization. Write code that can be executed repeatedly and produce consistent results.
Qualifications:
Overall 13-18 Years of Experience with 8-10 years of experience as a Data Engineer. Minimum 6 years of experience with Azure, ADF, Databricks, and Spark. Proficiency in PowerShell scripting. Strong SQL skills, including TSQL and PostgreSQL. Experience with parquet and delta formats. Understanding of SDLC and CI/CD processes. Ability to optimize code for performance and scalability. For more information please connect with Nixondas PRIMUS Global Services Direct Desk Ext:
218 Email:
Recommended Skills Apache Spark Automation Data Processing Databricks Etl Information Engineering Apply to this job. Think you're the perfect candidate? Apply on company site $(document).ready( function() $(#ads-desktop-placeholder).html(
n
n
n Estimated Salary: $20 to $28 per hour based on qualifications.
Responsibilities:
Utilize Azure services including ADF for orchestration, ADLS for storage, and AzureDevOps for CI/CD. Design, develop, and maintain ETL processes leveraging Databricks and Spark. Write and maintain PowerShell scripts for automation tasks. Utilize SQL (TSQL, PostgreSQL) for data manipulation and querying. Work with parquet and delta formats for efficient data storage and processing. Follow SDLC and CI/CD practices, including peer-reviewed code deployments. Optimize code for performance, including understanding indexes, partitioning, and resource utilization. Write code that can be executed repeatedly and produce consistent results.
Qualifications:
Overall 13-18 Years of Experience with 8-10 years of experience as a Data Engineer. Minimum 6 years of experience with Azure, ADF, Databricks, and Spark. Proficiency in PowerShell scripting. Strong SQL skills, including TSQL and PostgreSQL. Experience with parquet and delta formats. Understanding of SDLC and CI/CD processes. Ability to optimize code for performance and scalability. For more information please connect with Nixondas PRIMUS Global Services Direct Desk Ext:
218 Email:
Recommended Skills Apache Spark Automation Data Processing Databricks Etl Information Engineering Apply to this job. Think you're the perfect candidate? Apply on company site $(document).ready( function() $(#ads-desktop-placeholder).html(
n
n
n Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
