Senior Data Engineer Job at Sol-Ark, Allen, TX

VXUrMnN4bjY0S2lQSmpZSlE2VncxRmZBblE9PQ==
  • Sol-Ark
  • Allen, TX

Job Description

Location: This position will be on-site at our corporate offices in Allen, Texas (Dallas-Fort Worth area). **Not a remote position.

Please use this link to apply:

This is a full-time W-2 ONSITE opportunity (not remote)!

Work Eligibility:

  • Candidates must be legally authorized to work in the United States without requiring employer-sponsored visa sponsorship now or in the future.
  • At this time, we are unable to consider candidates on F1-OPT, H1B, or CPT status.

We are seeking an experienced Data Engineer with 10+ years of professional experience, specifically focused on developing Data pipelines, Data Lakes, and data warehouses for structured and unstructured data from millions of IoT Devices transmitting data to the cloud. The ideal candidate will have a strong technical knowledge of relational and NoSQL DB, data migration, data wrangling, Pre/Post post-processing, and Database administration. The candidate will have excellent problem-solving skills and a proven track record of delivering high-quality Data warehousing solutions. The candidate must be authorized to work in the US for any employer.

Responsibilities:

  • Ensure the high availability, low latency, high performance, efficiency, and stability of critical data infrastructure, supporting a range of data platforms for micro-services, APIs, and custom backend Java/JEE components.
  • An Expert in the design and development of real-time and offline batch processing of data pipelines for various custom enterprise Java Applications on AWS cloud systems.
  • An Expert in setting up different databases between environments, for multiple applications.
  • Expert at continuous data releases for different products and transferring data between environments.
  • Collaborate with Software and firmware development teams to design and implement solutions that create analytics, reporting, and related monitoring solutions.
  • Optimize resources (DB, Network Configuration,s etc.) utilization and minimize unnecessary expenditure on IT Data infrastructure.
  • Develop and maintain Confluence documentation for tools and pipelines.
  • Collaborate frequently with software developers to configure AWS Cloud IT Data security, QA, and integration development environments.

Requirements:

  • Building Data Pipelines to extract data from multiple sources and make data usable for business objectives.
  • Building Data Warehousing to prepare structured and unstructured data for use in analytics and reporting.
  • Building Data Lakes to manage large volumes of data, to move, transform, and analyze the data between cloud and on-premises.
  • Expertise in Data and Database migrations between different environments and applications. Work as a DBA, ability to manage and transfer the data between different applications.
  • Expert-level knowledge in the following areas: 
    • Infrastructure (AWS, Docker or related)
    • Database (MySQL, MongoDB, InfluxDB or similar time series)
    • DB SQL Languages (SQL, NoSQL, Python)
    • ETL/Batch processes (Spring Batch, Java)
    • Big Data (Hadoop, Apache Spark, Apache Parquet or similar)
  • Excellent communication skills both vertically and horizontally within the organization related to all aspects of technical leadership – written and verbal.

Desired Qualifications:

  • Experience in setting CICD /DevOps for Data Management.
  • Experience in managing APIs via Gateway, SWAGGER or similar tools for exposing data.
  • Experience in securing all the custom data and DB on AWS.
  • Experience in setting up data ingest points for real-time IOT applications.
  • Familiarity with TLS 1.2/1.3 implementations.
  • Understanding of electrical systems and power distribution.

Benefits:

Salary and Benefits: We offer a competitive salary and performance-based bonus program, top-tier benefits package, including medical, dental, and vision insurance, 401(k), and paid time off.

Job Tags

Full time, H1b, Visa sponsorship,

Similar Jobs

EAB

Director, Research & Strategic Advisory Services (Professional and Adult Education) Job at EAB

 ...advising them on strategy and best practice implementation. We currently have an opening on our Professional and Adult Education (PAE) team, which provides strategic and implementation advice for higher education executives in online, graduate, professional, continuing... 

Immigration Law PLLC

Immigration Legal Assistant Fluent in Spanish Job at Immigration Law PLLC

We are looking for an immigration legal assistant to join our legal team. The Immigration legal assistant will support our attorneys in preparing and filing immigration-related documents and managing client cases. The ideal candidate will have strong attention to detail... 

EOCFWA - Educational Opportunities for Children and Families

On Call Preschool Teacher Job at EOCFWA - Educational Opportunities for Children and Families

 ...you energized by teamwork and meaningful work with children? Would you like a flexible work schedule? Join EOCF as an On-Call Preschool Teacher! In this role you will assist the classroom teacher(s) in providing and implementing a developmentally appropriate... 

Community Options, Inc.

Early Intervention Service Coordinator Job at Community Options, Inc.

 ...Working as an Early Intervention Service Coordinator is a fun, rewarding, and meaningful position where you have a unique and incredible opportunity to positively change and enrich the lives of the individuals we serve. You would be a part of an amazing team who are fun... 

Bath Concepts Independent Dealers

Window Installers Job at Bath Concepts Independent Dealers

 ...Join the Total Remodeling Team Window Installer Apply Now or Call to Schedule Interview (***) ***-**** At Total Remodeling , we dont just replace windowswe improve homes and deliver peace of mind. As a fully licensed and insured contractor, our mission is...