Hadoop/ Big data Developer Job at Cloud Analytics Technologies LLC, Richmond, VA

RkZJZ0N0TXB2K0ltazVOQ0VybE03dDl5bEE9PQ==
  • Cloud Analytics Technologies LLC
  • Richmond, VA

Job Description

Job Description

Job Description :

Working Experience Software/Tools;

Experience with big data tools: Hadoop, Apache Spark, Kafka, etc.

Experience with Docker and Kubernetes

Experience with relational SQL, Snowflake and NoSQL databases, including Postgres and Cassandra.

Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Experience with object-oriented/object function scripting languages: Python, Java, C++, PySpark, Scala, etc.

Responsibilities for Data Engineer:

  • Create and maintain optimal data pipeline architecture,
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

Job Tags

Work experience placement,

Similar Jobs

Barnes & Noble

Lead Bookseller - FT Job at Barnes & Noble

 ...service that you provide and second by the training and delivery of first-class service by the entire store team.- Ensure a vibrant bookstore through the flawless execution of bookstore basics, showing a commitment to presentation, commerciality, section detail,... 

Northeast Georgia Health System

Registered Nurse - RN - MedSurg - Stroke Neuro - FT Nights Job at Northeast Georgia Health System

 ...helping with plans to improve NDNQI nursing sensitive indicators, RN Satisfaction, Employee Engagement, Culture of Safety, and Patient...  ...Qualifications Preferred Licensure or other certifications: BSN Preferred Educational Requirements: Preferred Experience:... 

Synchrony Group

Editorial Assistant/Project Coordinator Job at Synchrony Group

 ...encouraged to grow. Are you looking to be part of something great? Wed like to meet you! Job Description The Editorial Assistant/Project Coordinator is primarily responsible for improving the efficiency of the Editorial Services/Project Management departments... 

Stony Brook University

Untitled PositionHealth Sciences Librarian Job at Stony Brook University

 ...ask, or mandate, in any form, that an applicant for employment provide his or her current compensation, or any prior compensation history, until such time as the applicant is extended a conditional offer of employment with compensation. If such information has been requested... 

McKeever RV

RV Sales Associate Job at McKeever RV

 ...Come be a part of an exciting, new dealership experience. McKeever RV is a family-owned dealership that takes pride in having a family...  ...department that drives traffic in and the technology for todays sales environment as well. With our increased sales volume we need to...