Title: Data Engineer Location: Remote Visa: NO H1B ( Need Genuine only) Duration: 3+ Months Interview: 2 Videos Note: Need LinkedIn updated profile with Pic. Job Description: Need a Data Engineer for short term, 3 months+ person to help with their Client/Financial and expense reimbursement project. Certify & Yardi (makes apps for Prop Mngt/Real Estate companies) will be systems they will pull data from and merge data into Client. Extracts and data manipulation to feed back into various systems, must be experienced. They have not yet decided on Azure Logic Apps or Power Automation or end solution but will be helpful to have either or both here. Implementation of an expense program and/or financials helpful. ETL and data manipulation skills are key. Combination of good data analysis and DBA skills Project Overview - At a high level, getting data extracts out of 3 systems (Yardi, Certify), massaging that data, putting data back into a format to re-insert it back into those systems. Financial System - Some data coming out of the finance and reimbursement system - Lots of the data going back to this system Travel System - source and destination for some of this day HR (Workday) - Some data coming out of this system Each of these systems will push out a file, the Hub will massage the data, format correctly, then feed the data back to these systems Finance has data on GL codes, for instance Travel has data on all the travel logistics Workday has data on the specific employees This is being done as a backend processing piece, tying this info together Logic Apps and Power platforms skillset, data analytics skillset, applying rules to that data, getting them into a good format They are looking to build a piece that would serve as a Hub - Build a Hub that allows all the other tools to talk to each other - This Data Eng will help with building this - Greenfield Pulling data from a lot of sources - Data goes into Hub - Output from the data that feeds back into these systems, particularly back into the Finance System (expenses, reimbursements) A lot of the data going back to Finance would involve Employee Reimbursements Using a User Interface is not that critical (More Power Platforms, Logic Apps) Several databases - SQL Server, PostgreSQL, platform pieces often sit on top of Sharepoint Good candidate - Power Platform (PowerBI), SQL Server, Postgres, experience with data lakes like Hadoop (big data) is a big plus Want the resource available in a post deployment support mode, knowledge transfer to an FTE Some of this info may feed into a Data Lake, or pull data from the Data Lake (data lake in process of being developed)

Title: Principal DATA Engineer - Data Analytics Platform Duration: Direct Hire Visa: USC and GC only ( No Fake , Need Genuine Only) Location: Hybrid available in the following cities: Phoenix, AZ / Chicago, IL / New York, NY / San Francisco, CA ( Need local of these cities only) Interview: 2 Videos Need: Updated LinkedIn with profile pic. Job Description: This position is a hands-on, individual contributor and technical leader involved in setting the standards and ensuring excellence in quality of outputs across multiple teams to create an Analytics Data Platform. This initiative consists of creating an appropriate replica of various bespoke operational data stores and customer contribution data into a data platform that is fit for analytics and data science workloads. Scale and velocity should excite you, not scare you. We are looking for someone who has successfully built and delivered an Analytics Data Platform from the ground up. This is a principal level, individual contributor role responsible for architecting a Data Analytics Platform based on AWS technologies. They will also be responsible for acting as a player/coach with our existing analytics technical platform team consisting of senior and junior data engineers. They will have the support of our Sr. Director, Analytics Technical Platform. It is critical to have actual, hands-on experience architecting and building a data analytics platform for medium to large enterprise based on AWS technologies. Theoretical knowledge is not enough. Key Responsibilities:<ul> <li>Minimum 15 or more years of experience in designing and developing complex software projects.</li> <li>Experience in influencing cross-functional teams to create high throughput, high velocity data pipelines using both streaming and batch processing paradigms.</li> <li>Effective communicator with exceptional public speaking skills. Comfortable presenting to all levels within the company.</li> <li>Experience designing, implementing and operationalizing an analytics data platform in AWS.</li> <li>Networking experience relevant to moving data between on-prem and cloud environments.</li> <li>Experience with data handling processes such as retention policies, masking and encryption for compliance and visibility purposes.</li> <li>Current development skills using python, java or Scala.</li> <li>Experience with multiple data stores such as Oracle, MS-SQL Server, Postgres and noSql variety.</li> <li>Experience running a vendor selection process for relevant analytics platform needs.</li> <li>Expertise in terraform, k8s and/or other cloud orchestration technologies.</li> <li>Experience creating AWS observability and monitoring systems.</li> <li>Experience with several of the following AWS technologies: Glue/Glue Catalog/Glue Crawler, Kinesis/Firehose, RedShift, DynamoDB, Athena.</li> <li>Experience with ETL tools.</li> <li>Experience with data processing orchestration tools.</li> <li>Experience with data cataloging tools. </li></ul>Essential Functions:<ul> <li>Partners with product management to craft product strategy, create product descriptions and ensure alignment to technology roadmaps.</li> <li>Be a thought leader: a senior point of expertise on Data Engineering, Data Science, Business Intelligence, software engineering issues, industry trends and developing technologies. Be a role model to others on the team; coach and mentor team members. </li></ul><ul> <li>Takes ownership for creating technical product design and architecture - evaluating buy vs. build decisions and bought product maturity and fit for purpose.</li> <li>Works closely with customers to understand their needs and create a partnership for making products better.</li> <li>Documents SDLC artifacts so that other team members can understand and "follow the leader" - such as Confluence documentation, jira artifacts and associated MS-office documents (Excel, Word, PPT).</li> <li>Designs, implements and operationalizes a data analytics platform using AWS tools such as:</li> <li>S3 storage</li> <li>Glue and related tools</li> <li>Redshift, DynamoDB</li> <li>Athena</li> <li>Crawlers</li> <li>Observability matters using CloudWatch and CloudTrail</li> <li>Coach and develop others to use the above tools by creating small technical demonstrators or POCs.</li> <li>Creates and conducts presentations for small-to-medium size groups.</li> <li>Support the company's commitment to risk management and protecting the integrity and confidentiality of systems and data.</li> <li>The above job description is not intended to be an all-inclusive list of duties and standards of the position. Incumbents will follow instructions and perform other related duties as assigned by their supervisor. </li></ul>Minimum Qualifications:<ul> <li>Education and/or experience typically obtained through a bachelor's degree in computer science, or related technical field.</li> <li>Minimum 15 or more years of experience in designing and developing complex software projects.</li> <li>Experience in influencing cross-functional teams to create high throughput, high velocity data pipelines using both streaming and batch processing paradigms.</li> <li>Effective communicator with exceptional public speaking skills. Comfortable presenting to all levels within the company.</li> <li>Knowledge of Software Development Lifecycle (SDLC) best practices, software development methodologies (Agile, Scrum, LEAN etc) and DevOps practices.</li> <li>Experience designing, implementing and operationalizing an analytics data platform in AWS.</li> <li>Networking experience relevant to moving data between on-prem and cloud environments.</li> <li>Experience with data handling processes such as retention policies, masking and encryption for compliance and visibility purposes.</li> <li>Current development skills using python, java or Scala.</li> <li>Experience with multiple data stores such as Oracle, MS-SQL Server, Postgres and noSql variety.</li> <li>Experience running a vendor selection process for relevant analytics platform needs.</li> <li>Expertise in terraform, k8s and/or other cloud orchestration technologies.</li> <li>Experience creating AWS observability and monitoring systems.</li> <li>Experience with several of the following AWS technologies: Glue/Glue Catalog/Glue Crawler, Kinesis/Firehose, RedShift, DynamoDB, Athena.</li> <li>Experience with ETL tools.</li> <li>Experience with data processing orchestration tools.</li> <li>Experience with data cataloging tools.</li> <li>Background and drug screen. </li></ul>Preferred Qualifications: •Master's degree in computer science or related field. 972-392-5974 | 972-934-5200(103) ravi.chand@verdant-infotech.com, 5208 Windsor Ln, Copper Canyon, Texas, 75077

Data Engineer Jobs in Lewisville, TX

Data Engineer
November 18, 2024

Principal Data Engineer Data Analytics Platform
November 17, 2024

Principal Data Engineer Data Analytics Platform
November 11, 2024

Data Engineer With Snowflake Mortgagefinancial Domain
October 23, 2024

Quick filters

Top companies

Data Engineer Jobs in Lewisville, TX

Data EngineerNovember 18, 2024

Principal Data Engineer Data Analytics PlatformNovember 17, 2024

Principal Data Engineer Data Analytics PlatformNovember 11, 2024