Diverse Lynx
Senior Data Engineer with PySpark
Job Location
Wilmington, NC, United States
Job Description
Job Title: Senior Data Engineer with PySpark
Location: Mt Laurel, NJ / Charlotte, NC - (Hybrid)
Duration: Long term/Fulltime
Job description
10+ Years Candidate
Primary Tech skills - Databricks, Pyspark, Azure SQL, ADF
Secondary Tech skills - Azure, SAS, Synapse,
• Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
• Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling
• Hands-on experience in Pyspark is a must.
• Experience working with structured and unstructured data.
• Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
• Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
• Experience with Orchestration tools and GitHub
• Experience to own end-to-end development, including coding, testing, debugging and deployment.
• Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill
• Need to be an individual performer as well as a Lead.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Wilmington, NC, US
Posted Date: 11/23/2024
Location: Mt Laurel, NJ / Charlotte, NC - (Hybrid)
Duration: Long term/Fulltime
Job description
10+ Years Candidate
Primary Tech skills - Databricks, Pyspark, Azure SQL, ADF
Secondary Tech skills - Azure, SAS, Synapse,
• Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
• Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling
• Hands-on experience in Pyspark is a must.
• Experience working with structured and unstructured data.
• Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
• Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
• Experience with Orchestration tools and GitHub
• Experience to own end-to-end development, including coding, testing, debugging and deployment.
• Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill
• Need to be an individual performer as well as a Lead.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Wilmington, NC, US
Posted Date: 11/23/2024
Contact Information
Contact | Human Resources Diverse Lynx |
---|