IBM Data Engineer in St Louis, Missouri

Job Description

Ready to change the way the world works? This is your chance to establish innovative new technology products, as well as your career, with the world's second largest software-maker. Hone your expertise alongside fellow talented professionals, where you'll develop some of the most exciting software solutions on the market. At IBM and The Weather Company, we're strongly committed to the advancement of open Internet standards and applications.

The Weather Company (an IBM Business) is seeking a Data Engineer to utilize skills in DevOps and data management/engineering to work with architects, developers and other team members to design, build, and operationalize solutions for strategic enterprise data processing in geospatial data. Work will include development and playing a key role in the design, installation, testing and maintenance of software systems to aggressively manage the business needs for controlled structure in complex environments.

Location: Yorktown Heights, NY or Littleton, MA


You will be a part of a distributed team participating in BigData (Hadoop,SPARK) clusters development and deployment projects with large amount of data (> 1PB) following DevOps principles (on-premise and cloud)

Extend the BIG DATA line with some data formats: Parquet, ORC, Avro,

Extend the Analytics line with spatial topics: Spatial Analytics, GIS, GDAL

Proven experience in Agile and lean development

Good technical aptitude coupled with the ability to quickly understand new technology

Excellent communication, teamwork and a results-oriented attitude

Proficiency in problem solving and debugging

Required Technical and Professional Expertise

Bachelor’s degree in information technology, business, or related field, or equivalent combination of education and experience required.

10+ years data quality, data management, data/sw engineering or similar level experience required.

Experience in Geospatial analytics is preferred

Preferred Tech and Prof Experience

DevOps & automation: Kubernetes, Git, Github, Jenkins, Terraform,Chef,Docker

Experience in designing, running and troubleshooting Hadoop/SPARK clusters

BIGDATA: HBase, spark, hive, elastic search

Cloud: IBM Cloud, AWS, S3, Swagger

Strong understanding of Linux OS core principles, performance and tuning

Strong programming skills in the following languages: Python, Scala, SQL, Java, bash, c+Experience with Analytics : SPARK, python, scala, Jupyter notebooks

Strong knowledge of RDBMS management and application development: Postgres, MySQL, DB2

EO Statement

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.