Senior Data Engineer - Software

Hire Resolve's Client is on the hunt for an experienced Senior Data Engineer to enhance their team. This role will focus on designing and implementing data pipelines and architectures, ensuring data is accessible, reliable, and secure. The ideal candidate will work closely with cross-functional teams to support data analytics and business intelligence efforts, playing a key role in driving data-driven decisions across the organization. Responsibilities: Identify valuable data sources and automate data collection processes. Perform preprocessing on both structured and unstructured data. Analyze large datasets to discover trends and patterns. Expertise in Data Modeling (Relational and Star Schema). Skilled in database design, development, and administration. Experience in Data Warehouse design, build, and development. Proficiency in database performance tuning and optimization. Present data insights through data visualization techniques. Propose solutions and strategies to address business challenges. Collaborate with engineering and product development teams. Hands-on experience with Hadoop/Spark-based distributed storage and computing frameworks. Proficiency in real-time analytics and batch processing. Strong background in architecting analytical applications in cloud environments such as Amazon Web Services (AWS) and Microsoft Azure. Competencies: Critical Thinking: Skilled in using logic and reasoning to evaluate strengths, weaknesses, and approaches to solutions. Active Learning: Able to understand the impact of new information for current and future decision-making. Systems Analysis: Capable of determining how a system should function and assessing the effects of changes in conditions or operations. Complex Problem Solving: Ability to identify and address complex problems by developing and evaluating potential solutions. Deductive Reasoning: Proficient in applying general rules to specific problems for logical solutions. Inductive Reasoning: Skilled in combining information to identify relationships and form conclusions. Excellent Communication: Ability to engage with C-level stakeholders and convey a deep understanding of business and technology. Technical Literacy: Possesses a high level of technical proficiency to assess how software fits within an organizations structure. Analytical Assessment: Strong analytical skills for evaluating current systems and determining project needs and scope. Schedule Management: Extensive time management skills to set development schedules, milestones, and ensure timely delivery. Team Leadership: Experience in leading and motivating development teams throughout the project lifecycle. Strategic Execution: Ability to translate strategy into measurable and executable projects. Project Experience: Experience working on large-scale projects with established processes, procedures, and standards. Requirements: 8-10 years of experience as a Data Engineer or Database Developer. Tertiary qualification in a related field (e.g., BSc in Computer Science, B.IT, or Informatics). DP-203: Data Engineering on Microsoft Azure Certification. Expertise in data mining, large-scale data modeling, and business requirements gathering/analysis. Strong understanding and hands-on experience with data integration and transformation. Proficient in implementing data modeling methodologies such as Dimensional Modeling and/or Data Vault. Knowledge of data quality processes and master data management. Experience in building design support systems using Database Management Systems (DBMS) like SQL Server or Oracle. Skilled in designing and implementing data integration and ETL solutions using SSIS, Azure Data Factory, and/or SQL Server stored procedures. Familiarity with Big Data technologies such as Hadoop, MapReduce, Spark, and message/event processing services like Kafka, Event Hub, and Stream Analytics. Proficient in database query languages including T-SQL, ANSI SQL, and PL/SQL. Some experience in software development using languages like Visual Basic, C++, C#, Java, or Python. Experience with SQL Server Management Studio and Visual Studio. Knowledge of implementing solutions using Azure SQL databases, Azure Synapse, Azure Storage Accounts (Data Lake), and/or Databricks. Strong analytical skills and business acumen. Additional skills in Tableau, Power BI, advanced math (e.g., statistics, algebra), Scala, Python, or R are advantageous. Benefits: Contact Hire Resolve for you next career-changing move Our client is offering a highly competitive salary for this role based on experience. Apply for this role today, contact Kay-Leen Recruiter at Hire Resolve or on LinkedIn You can also email to kay-leen.dupreezhireresolve.us Please use in the subject line "Senior Data Engineer - Pretoria" You can also visit the Hire Resolve website: hireresolve.us or email us your CV: itcareershireresolve.za.com We will contact you telephonically in 3 days should you be suitable for this vacancy. If you are not suitable, we will put your CV on file and contact you regarding any future vacancies that arise.

Location: Pretoria, ZA

Posted Date: 11/2/2024