Gaana is seeking a detail-oriented and analytical Data Analyst to join our team. The successful candidate will collect, organize, and analyze consumer data to inform business decisions, identify trends, and optimize processes. KEY RESPONSIBITILES: <ul><li>Developed and optimized complex financial reports and interactive dashboards for Collections and Risk teams, utilizing industry-leading BI tools such as Power BI, DOMO, and Looker to provide actionable insights and enhance decision-making.</li><li>Implemented dataflows, Magic ETLs, and SQL stored procedures to analyze data relationships, track KPIs, and uncover trends, improving data accessibility and driving process efficiency.</li><li>Led the migration of reports and datasets from MS SQL Server to Google BigQuery, improving infrastructure efficiency by ~40%, reducing data retrieval time, and enhancing data accuracy.</li><li>Collaborated globally with cross-functional teams and stakeholders, ensuring seamless communication and delivery of high-priority initiatives under tight deadlines, fostering a culture of agile development and cross-functional alignment.</li><li>Train and mentored new team members and junior analysts, ensuring proper knowledge transfer of BI tools, reporting methodologies, and data management best practices, contributing to team scalability and improved performance.</li></ul> Experience & Education: BE/B.Tech with 2-5 Years in software product companies Must-Haves Skills: <ul><li>BI Tools: Tableau, DOMO, Power BI, Looker;</li><li>Databases: Amazon Redshift, Trino, MySQL, GCP BigQuery, MS SQL Server, Firebase;</li><li>Languages: SQL, Python, Scala, R, Java;</li><li>Others: ETL, AWS, Bitbucket, Git, JIRA, MS Office (Excel, Docs, Access)</li></ul>

Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing performance on Databricks Spark, and orchestrating workflows using various tools. Key Responsibilities:• Data engineering and analytics project delivery experience – Min. 2+ years• Min. 2 project done in past of Databricks Migration (Ex. Hadoop to Databricks, Teradata to Databricks, Oracle to Databricks, Talend to Databricks etc)• Hands on with Advanced SQL and Pyspark and/or Scala Spark• Min 3 project done in past on Databricks where performance optimization activity was done • Design, develop, and optimize data pipelines and ETL processes using Databricks and Apache Spark.• Implement and optimize performance on Databricks Spark, ensuring efficient data processing and management.• Develop and validate data formulation and data delivery for Big Data projects.• Collaborate with cross-functional teams to define, design, and implement data solutions that meet business requirements.• Conduct performance tuning and optimization of complex queries and data models.• Manage and orchestrate data workflows using tools such as Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, and/or AWS Glue.• Maintain and ensure data security, quality, and governance throughout the data lifecycle. Technical Skills:• Extensive experience with PySpark and Scala-Spark.• Advanced SQL skills for complex data manipulation and querying.• Proven experience in performance optimization on Databricks Spark across at least three projects.• Hands-on experience with data formulation and data delivery validation in Big Data projects.• Experience in data orchestration using at least two of the following: Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, AWS Glue. Preferred Qualifications:• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.• Familiarity with data governance and data security best practices.• Experience with other Big Data technologies and frameworks is a plus.

Job Description: Data EngineerLocation: Noida About Varahe Analytics:Varahe Analytics is one of India’s premier integrated political consulting rms specializing in building data-driven 360-degree election campaigns. We help our clients with strategic advice and implementation, combining data-backed insights and in-depth ground intelligence into a holistic electoral campaign. We are passionate about our democracy and the politics that shape the world around us. We draw on some of the sharpest minds from distinguished institutions and diverse professional backgrounds to help us achieve our goal. The team brings in 7 years of experience in building electoral strategies that spark conversations, eect change, and help shape electoral and legislative ecosystems in our country. About the Team:As a part of the Social Media Reporting & Analysis team at Varahe Analytics, you will have a chance to understand and analyze social media and perform original research and analysis in areas related to politics for a national party with a presence across India.The role demands high levels of confidentiality, good social skills, an eye for detail, and disciplined adherence to documentation protocols and deadlines. Working Experience:0-1 yearsEducational Qualication:Bachelor's degree and above What Would This Role Entail?● Design, develop, and maintain data pipelines to ingest, process, and store large-scale datasets efficiently using Python and Google Cloud Services (GCS)● Implement and optimize data workows and ETL (Extract, Transform, Load) processes to ensure data availability and quality for business intelligence and analytics● Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver scalable solutions● Ensure the security, reliability, and scalability of data infrastructure using best practices on Google Cloud Platform (GCP)● Continuously monitor and improve the performance of data systems, troubleshooting issues, and implementing enhancements as needed● Develop and maintain documentation for data architecture, pipelines, and processes to ensure clarity and transparency across teams Necessary Skills:● Proficiency in Python: Strong coding skills in Python, with experience in using libraries and frameworks for data processing (e.g., Pandas, PySpark)● Experience with Google Cloud Services: Hands-on experience with GCP tools and services like BigQuery, Cloud Storage, Dataow, and Pub/Sub● Database Management: Strong understanding of relational databases, SQL, and experience in managing data warehouses on GCP● ETL Development: Experience in building and maintaining ETL pipelines, with an emphasis on automation and optimization● Problem-Solving Skills: Ability to troubleshoot complex data issues and provide effective solutions.● Collaboration and Communication: Strong communication skills to work effectively with cross-functional teams and convey technical concepts to non-technical stakeholders If you're a motivated individual with a passion for building robust data infrastructure and driving business impact through data engineering, we’d love to hear from you! Drop an email at openings@varaheanalytics.com with a mention of your experience with Python and Google Cloud Services.

<ul><li>JD – Data Engineer with Python</li><li>Role & Responsibilities –</li><li>•​Lead the creation, development, and implementation of critical system design changes, enhancements, and software projects</li><li>•​Ensure timely execution of project deliverables</li><li>•​Work with other engineers to ensure the system and product is consistent and aligned through all processes</li><li>•​Improve product quality, performance, and security through substantial process improvements</li><li>•​Follow development standards and promote best practices</li><li>•​Individual contributor as an engineer</li><li> </li><li>Requirements & Qualifications –</li><li>•​Bachelor's degree in Computer Science, or a related field (or equivalent experience)</li><li>•​5+ years experience in understanding data sources and their access to the data.</li><li>•​Building pipelines to bring in data of very different sources, preparing / aligning datasets for comparisons, presentations, dashboards, basic statistical analytics etc.</li><li>•​Close support for business to help with analytics or SQL queries, data excerpts/examples</li><li>•​Experience with data manipulation libraries like pandas, NumPy</li><li>•​Understanding and potentially improving Python / Snowflake based toolchain</li><li>•​Proficiency in SQL programming and database management systems such as PostgreSQL, SQL Server, and Snowflake</li><li>• Experience with database design and normalization principles. Knowledge of indexing, query optimization, and performance tuning.</li><li> </li><li>• Familiarity with ETL (Extract, Transform, Load) processes and tools.</li><li> </li><li>• Understanding of data warehousing concepts and practices (good to have)</li><li> </li><li>• Tools: Git, PgAdmin, MS SQL Sever Management Studio, PyCharm, Visual Studio Code</li><li>• Languages: Python</li></ul>

Data Engineer Jobs in Noida, Uttar Pradesh

Data Engineer Analyst
November 18, 2024

Senior Data Engineer
November 9, 2024

Data Engineer
October 24, 2024

Data Engineer With Python
October 24, 2024

Quick filters

Top companies

Data Engineer Jobs in Noida, Uttar Pradesh

Data Engineer AnalystNovember 18, 2024

Senior Data EngineerNovember 9, 2024

Data EngineerOctober 24, 2024