Xperteez Technology Logo

Xperteez Technology

Data Engineer, Remote

Reposted 5 Days Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Build and scale distributed data pipelines and architectures supporting AI products and research. Responsibilities include processing large datasets with Spark, designing AWS data systems, managing SQL and NoSQL storage, writing Python and SQL, ensuring data quality and reliability, and implementing automation, orchestration, monitoring, and scalable data operations.
The summary above was generated by AI

Job Title: Data Engineer

Job Type: Full-time

Location: Remote

We are looking for a Data Engineer to build and scale the data infrastructure that powers AI-driven products and research initiatives. In this role, you will develop distributed data pipelines, manage large-scale datasets across cloud environments, and design reliable data systems that support data processing, experimentation, and model development at scale.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines to ingest, process, and transform large-scale datasets from multiple sources.

  • Develop and optimize distributed data processing workflows using Spark and cloud-native technologies.

  • Build and maintain data storage solutions across SQL and NoSQL systems, ensuring scalability, performance, and reliability.

  • Design and implement data architectures on AWS to support high-volume data ingestion, processing, and distribution.

  • Write efficient Python and SQL code to extract, transform, validate, and analyze large datasets.

  • Ensure data quality, integrity, monitoring, and operational reliability across data pipelines and storage layers.

  • Collaborate with AI researchers, data scientists, and engineering teams to support data-intensive applications and experimentation.

  • Implement automation, orchestration, and monitoring workflows to support scalable and efficient data operations.

Required Skills and Qualifications

  • Strong proficiency in Python, SQL, and distributed data processing frameworks such as Apache Spark.

  • Hands-on experience with AWS data services and cloud-native data architectures.

  • Experience working with both SQL and NoSQL databases.

  • Experience managing and processing large-scale datasets in distributed environments.

  • Strong understanding of data partitioning, performance optimization, and scalable data architectures

Nice to Have

  • Exposure to AI/ML workflows or research environments.

  • Experience with data visualization tools such as Matplotlib, Seaborn, or Plotly.

  • Familiarity with LLM-related data workflows (datasets for training, evaluation, or prompt experimentation).

Compensation & Benefits Notice

The base salary for this full-time position is as per the national pay range in USD. All employees are eligible for equity compensation, and employees may also receive performance-based bonuses, dependent on role and subject to company policies. Comprehensive benefits package, including up to 100% reimbursement for health-insurance premiums, paid time off, a 401(K) plan with a company match, and additional benefits designed to support a high-performing, remote-first workforce.

Our hiring process utilizes artificial intelligence tools to assist in candidate screening and assessment. Our AI tools are designed to complement, not replace, human decision-making.

Disclaimer

The information contained in this job posting, including but not limited to role responsibilities, qualifications, compensation, and benefits, is provided for informational purposes only and does not constitute a binding offer of employment. micro1 reserves the right to amend, modify, or withdraw any portion of this posting at its sole discretion and without prior notice. All employment decisions are made in accordance with applicable laws and regulations.

Similar Jobs

9 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.
Top Skills: Ai TechnologiesApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
10 Days Ago
In-Office or Remote
120K-215K Annually
Senior level
120K-215K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and lead production AI/ML, Generative AI, and data engineering solutions for healthcare analytics and patient safety platforms. Develop full-stack applications, microservices, APIs, data pipelines, dashboards, self-service analytics, RAG systems, and event-driven architectures using cloud-native technologies. Apply engineering best practices including testing, CI/CD, observability, security, and performance optimization. Mentor engineers, lead technical initiatives, and collaborate with product, analytics, business, and platform teams.
Top Skills: Amazon KinesisAWSAzureAzure Event HubsCi/CdDatabricksDelta LakeGCPGenerative AiJavaJavaScriptKafkaLarge Language Models (Llms)Microsoft FabricMlopsPysparkPythonReactRest ApisRetrieval-Augmented Generation (Rag)SnowflakeSparkSpring BootSQLTypescriptVector Search
10 Days Ago
Remote or Hybrid
172K-301K Annually
Senior level
172K-301K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead architecture and technical direction for a high-volume log analytics platform spanning ingestion, storage, querying, reliability, and AI-driven capabilities. Shape the roadmap with engineering, product, leadership, and customers; build prototypes; guide migrations and schema changes; set reliability and cost standards; influence teams without direct ownership; mentor senior engineers and technical leads; and promote strong practices in quality, on-call operations, and incident learning.
Top Skills: AIAmazon KinesisApache PulsarCloud InfrastructureColumnar DatabasesElasticsearchGoJavaKafkaKubernetesLlmsObject StorageOpensearchOpentelemetryPythonRustScalaTime-Series Databases

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account