FernHConsultancy
Informatica Developer - ETL/SQL/Python
Job Location
in, India
Job Description
Job : Informatica Developer About Client : We are a preferred and trusted Technology Consulting and Development Partner for global enterprises, from start-ups to Fortune 500s. Work with different stakeholders of the knowledge value chain to provide the Business Intelligence, Data Analytics and Technology solutions which enables them to make the informed decisions and solve the business challenges. Our Services include Business Intelligence, Data Analytics, Data Visualization, Artificial Intelligence, Power BI Services, Power Apps, Power Automate, Product Development, Generative AI, Low-Code/No-Code, Microsoft Fabric. We have been in the market for the last 10 successful & progressive years with 100 successful delivery of projects. Cient started its regional office in the USA in 2023. It has an extensive Global Experience & Capabilities to provide Technology support in a major part of the world. About the Role : The Informatica Developer plays a key role in the development, maintenance, and optimization of data integration solutions using Informatica PowerCenter, Informatica Cloud, and other related technologies. This role involves designing and implementing ETL (Extract, Transform, Load) processes to manage data flows across various databases, data warehouses, and cloud platforms. As an Informatica Developer, you will be responsible for ensuring efficient, high-quality data transfer, transformation, and integration to support business intelligence, reporting, and data analytics efforts. Key Responsibilities : ETL Development and Optimization : - Design and Develop ETL Workflows : Create and maintain ETL mappings, sessions, and workflows using Informatica PowerCenter or Informatica Cloud. This includes extracting data from different sources (e.g., databases, flat files, APIs), transforming it according to business rules, and loading it into target data storage solutions such as data warehouses or cloud storage. - Optimize ETL Jobs : Identify and resolve performance bottlenecks in existing ETL jobs. Apply techniques such as Pushdown Optimization, Partitioning, and Parallel Processing to enhance performance and minimize processing time, particularly when handling large volumes of data. - Data Transformation : Use Informatica transformations such as Expression, Filter, Joiner, Lookup, Aggregator, and Router to perform necessary data transformations to meet business requirements. Ensure that data integrity and consistency are maintained throughout the ETL process. Data Integration and Quality Control : - Data Integration : Integrate data from various sources including relational databases, cloud-based storage, and flat files. Work with a variety of data structures and formats such as JSON, XML, CSV, and parquet files. - Data Quality and Validation : Ensure data quality by implementing data validation rules, performing data profiling, and applying data cleansing techniques. This ensures that only clean, accurate data is loaded into target systems for analysis or reporting. - Data Transformation Logic : Implement business logic transformations to clean and standardize data, such as dealing with missing values, formatting issues, or inconsistent data types. Collaborate with data architects to apply data governance standards. Job Scheduling and Monitoring : - ETL Job Scheduling : Use Informatica Workflow Manager to schedule, automate, and manage the execution of ETL jobs. Schedule jobs according to business needs (e.g., nightly, weekly, or on-demand). Ensure the timely execution of all jobs and workflows. - Monitor Job Execution : Continuously monitor the execution of ETL processes to ensure smooth operation. Review logs, address failures, and ensure the completion of all processes without errors. Set up automated alerts for job failures, data discrepancies, or performance issues. - Debugging and Troubleshooting : Investigate and resolve issues with ETL workflows, including data discrepancies, failed jobs, or transformation errors. Use Informatica's debugging tools to troubleshoot issues and improve job reliability. Collaboration and Communication : - Collaboration with Stakeholders : Work closely with data analysts, business analysts, and data architects to understand business requirements and ensure that ETL processes align with those needs. Collaborate on designing and refining data models and workflows. - Documentation : Maintain detailed documentation of the ETL processes, including mapping specifications, transformation rules, data flow diagrams, and troubleshooting guides. This documentation is critical for ongoing maintenance and for auditing purposes. - Cross-Functional Collaboration : Collaborate with other technical teams, such as data warehousing and BI teams, to ensure the integration of data into reporting and analysis systems. Provide technical support and guidance to other team members as needed. Performance Tuning and Optimization : - Performance Tuning : Constantly monitor and tune ETL jobs to ensure that they run efficiently. Address performance issues by optimizing SQL queries, leveraging session partitioning, and applying pushdown optimization to reduce load times and increase throughput. - Resource Management : Optimize resource allocation to avoid bottlenecks. Configure job settings, adjust memory settings, and manage the resources used by Informatica sessions to improve processing speed and reliability. - Database Performance : Work closely with database administrators to ensure that database queries are optimized and that ETL jobs are executed efficiently. Skills and Qualifications : Core Technical Skills : - Informatica PowerCenter : Advanced knowledge and hands-on experience with Informatica PowerCenter, including developing mappings, sessions, and workflows. - ETL Design and Development : Strong experience in designing, developing, and maintaining complex ETL workflows, using various transformations such as Joiner, Lookup, Aggregator, and Expression. - SQL Expertise : Strong proficiency in SQL for querying relational databases and performing data transformation. Knowledge of writing optimized SQL queries and stored procedures. - Informatica Cloud : Familiarity with Informatica Cloud Data Integration is a plus. Experience in building cloud-based ETL solutions for data integration and migration. - Database Knowledge : Proficiency with databases like SQL Server, Oracle, and MySQL, including database design, normalization, and performance tuning. - Scripting Languages : Basic knowledge of scripting languages such as Shell, Python, or Perl for automating tasks and handling data operations. - Data Integration Tools : Experience with other data integration or ETL tools such as Talend, Microsoft SSIS, or Apache Nifi is a plus. - Cloud Platforms : Exposure to cloud platforms like AWS, Azure, or Google Cloud is beneficial, especially with cloud storage solutions such as Amazon S3 or Azure Blob Storage. Soft Skills : - Problem Solving : Strong analytical and troubleshooting skills to identify and resolve issues related to ETL jobs and data integrity. - Attention to Detail : Meticulous attention to detail in data transformation and validation to ensure high data quality and consistency. - Communication Skills : Strong written and verbal communication skills to effectively interact with cross-functional teams and stakeholders. - Teamwork : Ability to work collaboratively in a team environment, sharing knowledge and supporting the development of peers. Experience Requirements : - 3-8 years of hands-on experience in ETL development with Informatica PowerCenter and Informatica Cloud Data Integration. - Proven experience in data integration, data migration, and data transformation in complex, large-scale environments. - Experience in integrating data from multiple sources (relational databases, flat files, cloud-based data) into target systems like data warehouses or data lakes. - Familiarity with cloud platforms, including working with cloud storage and cloud-based data services. - Experience with data warehousing and business intelligence (BI) solutions is highly beneficial. Educational Requirements : - A Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. - Additional certifications in Informatica PowerCenter or cloud platforms are a plus but not required. (ref:hirist.tech)
Location: in, IN
Posted Date: 2/14/2025
Location: in, IN
Posted Date: 2/14/2025
Contact Information
Contact | Human Resources FernHConsultancy |
---|