Who We Are Looking For: (Open-source Committers/Contributors)We are seeking seasoned professionals with a deep understanding and expertise in large-scale distributed systems and platform development using open-source software. Ideal candidates will have:<ul><li>Expertise in Distributed Systems: Proven experience in designing, developing, and maintaining large-scale distributed systems.</li><li>Open-Source Contributions: Active involvement in the open-source community, particularly in streaming, analytical, and low-latency services.</li><li>Technical Proficiency: Strong proficiency in technologies such as Apache Druid, Apache Pinot, Apache Spark, Apache Flink, Apache Kafka, Temporal, and Yugabyte.</li><li>Innovative Mindset: A passion for innovation and a drive to stay ahead of the curve by continuously exploring and implementing new technologies.</li></ul> Job DescriptionVisa's Data and AI Platform team is at the forefront of transforming the payment industry by harnessing the power of big data, artificial intelligence, and cutting-edge open-source technologies. Our mission is to build scalable, high-performance data platforms and services that enable Visa’s businesses to innovate and deliver unparalleled value to our customers worldwide. Our WorkAt Visa, we are dedicated to developing robust data platforms that handle massive volumes of data, ensuring real-time processing, analytics, and low-latency responses. Our team leverages a variety of open-source software to create flexible, efficient, and reliable solutions that meet the dynamic needs of our business operations.<ul><li>Big Data Platforms: We design and implement platforms capable of processing and analyzing vast amounts of data generated by millions of transactions daily. These platforms support various use cases, from fraud detection to personalized customer experiences.</li><li>Open-Source Software: Our development approach heavily relies on open-source technologies, allowing us to build innovative solutions while contributing to the wider tech community. We use and contribute to projects like Apache Hadoop, Apache Druid, Apache Pinot, Apache Spark, Apache Flink, and Apache Kafka, among others.</li><li>Cutting-Edge Technologies: To achieve our goals, we incorporate state-of-the-art technologies in our stack. This includes leveraging streaming analytics, real-time data processing, and low-latency services to ensure that our platforms are always at the cutting edge of performance and reliability.</li></ul> The candidate must have:<ul><li>Actively participate in all phases of software development lifecycle: analysis, technical design, planning, development, testing/CICD, release, post production/escalation support</li><li>Work on a highly scalable, available and resilient multi-tenant Platforms that can host large scale and highly critical applications.</li><li>Develop large scale multi-tenant software components on the Platform in an Agile based methodology to provide self-service capabilities.</li><li>Collaborating with partners from business and technology organizations, develop key deliverables for Data Platform Strategy - Scalability, optimization, operations, availability, roadmap.</li><li>Build partnerships with other technology teams to drive efficiency in their use of platforms and services that PaaS provide</li><li>Expertise in applying the appropriate software engineering patterns to build robust and scalable systems.</li><li>Be a self-starter, work independently and Mentor junior members in the scrum team. Stays current with new and evolving technologies</li><li>Builds strong commitment within the team to support the appropriate team priorities</li><li>This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.</li></ul> Additional InformationVisa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Data Engineer, Sr Consultant, PersonalizationBangalore, IndiaFull-timeCompany Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description The Global Data OfficeWith data being the fuel that drives our future - our strategies, policies, and business successes around data will define our future growth prospects. Unlocking the value available through the innovative use of data on behalf of consumers, businesses, and communities is key to our future. With our ongoing commitment to Visa’s Data Values and the responsible use of data, we at Visa have a bold vision to continue to grow and accelerate our data-related businesses and capabilities.Led by Visa’s first Chief Data Officer, the Global Data Office coordinates high-impact, complex, company-wide projects related to data business strategy, critical investments, policy development, and marketplace execution. Working closely with Visa’s Chief Privacy Officer, the Technology organization, the wider data community, and the full set of Visa’s global lines of business, the Global Data Office is evolving Visa’s data-related work with momentum and enthusiasm. Driven by its commitment to trusted use of data, Visa is seeking enthusiastic leaders who are change-agents and passionate about the future of data around the world.The Global Personalization team comes under the Global Data Office and comprises of data practitioners with diverse data skillsets ranging from data science, data engineering, ML engineering and ML operations. The team is responsible for using Visanet data in creating near real time signals which are consumed by our clients for creating hyper personalized offers and decisions on their end customers.We are looking for an exceptional technical leader in data engineering domain, who will be part of Global Personalization team and will report into the Head of Data Engineering within Global Data Team. In this role, you will be a Senior Manager/Architect, responsible in setting and managing the Data Engineering work stream. The ideal candidate will possess robust experience in data engineering and be adept at navigating the complexities associated with building, deploying and maintaining large Metric repositories. Your role will encompass the complete lifecycle of data repository management, from their development and testing to their deployment and data processing frameworks and applications using in-house tools and technologies.You will partner closely with Global stakeholders across consulting, data science, data engineering, technology, and other teams. You will get chance to leverage your strategic planning, business analysis and technical knowledge of data engineering architectures, tools and solutions. You will also be a hands-on expert who can effectively partner with cross-functional teams to build effective data repositories.Primary responsibilities<ul><li>Architecture & Design: Lead the architecture and design of the Metric repository across all regional requirements, using re-usable functions and frameworks ensuring scalability, reliability, and performance.</li><li>Data Analysis: Lead the discussions with the requestors from across the regions, around understanding the Metric requirements and defining a process to standardize the Metrics and building the Metric repository</li><li>Data Integration: Architect and oversee the integration of various data sources, including Transactional systems, Global and Regional data assets.</li><li>Data Pipeline Development: Setup and lead a team Data Engineers, who will be responsible to build new scripts to development the metrics or re-engineer scripts created by the Data science teams, such that they can be easily plugged into existing ML Ops frameworks.</li><li>AI/ML: Design and develop the integration of the AI/ML models outputs into the Metric repository, build the ML Ops components to support and manage the lifecycle of AI based models built by the regional and global data science teams.</li><li>Data Quality and Governance: Establish and enforce data quality standards and governance policies around Data, Metrics management and all client deliveries.</li><li>Code Review and Best Practices: Conduct code reviews and ensure adherence to best practices in development and deployment.</li><li>Documentation: Maintain comprehensive documentation for all data assets and data engineering processes.</li><li>Team Management & Collaboration: Lead the Personalization Data Engineering team, with end to end ownership of building the Metric repository. Collaborate with Data engineers, Data scientists and various groups within the organization to identify areas of improvement, bottlenecks and re-use existing frameworks/processes.</li></ul> Technical skills<ul><li>Experience in building large globally applicable data platforms using different data modelling, data storage and data flow techniques to support the technical and business use cases and a solid understanding of best practices in data engineering</li><li>Experience with machine learning model inference, validation, deployment and management of BAU operations.</li><li>Knowledge of a variety of machine learning techniques (clustering, decision tree, etc.) and their real-world advantages/drawbacks.</li><li>Strong programming skills in building data pipelines using PySpark, Hive, Airflow.</li><li>Experience working with scheduling tools (Airflow, Oozie) or building data processing orchestration workflows.</li><li>Hands-on experience working with large scale data ingestion, processing, and storage in the Hadoop ecosystem</li><li>Experience in writing and optimizing SQL queries in Big data environment.</li><li>Experience in creating data dictionaries, setup and monitor data validation alerts, and execute periodic jobs to maintain data pipelines for completed projects</li><li>Experience working in Linux/Unix environment and exposure to command line utilities.</li><li>Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems.</li><li>Experience working in building and integrating the code in the defined CI/CD framework using git.</li><li>Experience in drafting solution architecture frameworks that rely on API’s and micro-services</li></ul>Strategic and Functional Excellence<ul><li>Good business acumen to orient data analysis to business needs of clients, including experience in the payments space.</li><li>Ability to translate data and technical concepts into requirements documents, business cases and user stories.</li><li>Good understanding of agile working practices and related program management skills.</li><li>Should have strong problem-solving capabilities and ability to quickly propose feasible solutions and effectively communicate strategy and risk mitigation approaches to leadership.</li><li>Good communication and presentation skills with ability to interact with different cross-functional team members at varying levels</li><li>Ability to learn new tools and paradigms as data science continues to evolve at Visa and elsewhere.</li></ul> This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs. Qualifications • 12+ years of relevant work experience with a Bachelor’s Degree or 10+ years of relevant work experience with a Master's or Advanced Degree with specialization in Computer science, Information science, Data Engineering and Analytics or relevant area.• 5+ years of experience managing technical architecture, tooling and design systems for Data/ML products/solutions preferably in a financial services or consulting setting• 5+ years of experience leading BI/ data visualization projects and related skills• Familiarity with shared services, consulting, financial services is a strong plus• Fundamental and broad knowledge of common data tools and methodologies Additional information Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose - to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description Our team is dedicated to providing systems and services to make data secure, high quality, rich, fast, and easy to use, therefore enabling Visa the ability to leverage its data asset in an effective and timely manner to maximize technology/business development and differentiate Visa from others in the payment industry. We are seeking an intern to join the team in the summer of 2025, and as an intern, you will get the chance to work with multiple teams, systems, and products through a wide variety data sources using Big Data and Cloud technologies. As an intern, you will get the opportunity to work on optimizing or redesigning our company's data architecture to support our next generation of products and data initiatives. Our summer internship also comes with social and professional networking events and developmental workshops, designed to provide you the resources and training to have an impactful summer. You will get to work on one or several hands-on projects with the team. Some job duties and projects could include: <ul><li>Self-serve deployment of Kafka clusters using Docker and Kubernetes with auto scale up capability.</li><li>Creating a natural language Chatbot for searching CDISI knowledge base.</li><li>Open NSFW & Apache SeaTunnel</li><li>Data Infused Presentation Builder</li><li>Smart Client Narration</li></ul> Qualifications Basic Qualifications <ul><li>Students pursuing a Bachelor's or Masters degree in Computer Science, Computer Engineering, CIS/MIS, Cybersecurity, Business or a related field, with less than 2 years relevant work experience, graduating December 2025 or later.</li><li>Strong communications skills, specifically, the absence of repeated grammatical or typographical errors, clear and concise written and spoken communications that demonstrate professional judgment. </li></ul> Preferred Qualifications <ul><li>Proficiency in at least one programming language or technology including, but not limited, to: Python, Java, SQL, LINUX/UNIX, React.js, Scala, Spark, PySpark, Hadoop, Kafka, Rust, NoSQL, or Kubernetes</li><li>Coursework or Knowledge of Gen AI, LLM, Machine Learning</li><li>Knowledge of Distributed Systems Design, Scalability, High Availability Resiliency</li><li>Knowledge in Mobile Device delivery. E.g. Cloud Services, plugins</li><li>Well-versed in MS Excel and knowing how to use function(s) such as V-Look Up or Formulas</li><li>The ability to take on challenges and address problems head-on</li><li>Strong ability to collaborate</li><li>Highly driven, resourceful and results oriented</li><li>Good team player and excellent interpersonal skills</li><li>Good analytical and problem-solving skills</li><li>Demonstrated ability to lead and navigate through ambiguity</li></ul> Additional Information U.S. APPLICANTS ONLY: The estimated hourly range for a new hire into this position is $27.00 to $31.00 which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401 (k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program. Work Authorization: Visa will not sponsor applicants for work visas in connection with this position. Future sponsorship will not be considered. Work Hours: Varies upon the needs of the department. This is a hybrid position: Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs. Travel Requirements: This position requires travel 5-10% of the time. Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers. Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law. Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

Data Engineer Visa Jobs

Staff Data Engineer
December 14, 2024

Sr Consultant Data Engineer Personalization
December 12, 2024

Data Engineer Intern Summer 2025
December 7, 2024

Quick filters

Top companies

Data Engineer Visa Jobs

Staff Data EngineerDecember 14, 2024

Sr Consultant Data Engineer PersonalizationDecember 12, 2024

Data Engineer Intern Summer 2025December 7, 2024

Quick filters

Top companies

Staff Data Engineer
December 14, 2024

Sr Consultant Data Engineer Personalization
December 12, 2024

Data Engineer Intern Summer 2025
December 7, 2024