Data Engineer Data Engineer …

Experian Information Solutions Incorporated
in Milpitas, CA, United States
Permanent, Full time
Be the first to apply
Competitive
Experian Information Solutions Incorporated
in Milpitas, CA, United States
Permanent, Full time
Be the first to apply
Competitive
Data Engineer
🌎 English English (United Kingdom) Espaol Portugus (Brasil) () This job posting isn't available in all website languages ☰ Big Data Engineer 📅 Jun 27, 2019 Post Date 📅 194625 Requisition # Apply for Job Share this Job Experian is seeking a Big Data Engineer to join our CIS Product Delivery team. This is a great opportunity for someone who specializes in Kafka Architecture to enable cloud-based financial services platform to access timely, accurate and relevant data. An ideal candidate will have built real time software services platforms where large volume messaging is core to the solution set.

About Experian

Experian is the worlds leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses and society. For five years in a row, we have been named in the Top 100 Worlds Most Innovative Companies by Forbes Magazine. With a focus on our employees, we were rated the #1 Top Workplace by the Orange County Register. Experian Consumer Information Services is redefining the way our clients do business within all aspects of the customer credit lifecycle. Fueled by best-in-class data and innovative technology we help businesses make smarter decisions, identify consumers, make decisions on loans, market to prospects and collect.

About this role

As a Big Data Engineer, you must be a messaging expert with extensive, well-rounded background in a diverse set of messaging middleware solutions (commercial, open source, in-house) with in-depth understanding of architectures of such solutions such Kafka. Youll need an established track record with Kafka technology (administration, configuration, and troubleshooting), with hands-on production experience and a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components such as Kafka Connect, Kafka Streams. Additional responsibilities for this position include:
  • Design, develop and implement the Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Attunity, Schema Registry, and other streaming-oriented technology
  • Assist in building out the DevOps strategy for hosting and managing our SDP microservice and connector infrastructure in AWS cloud
  • Strong track record of design/implementing big data technologies around Apache Hadoop, Kafka streaming, No SQL, Java/J2EE and distributed computing platforms in large enterprises where scale and complexity have been tackled.
  • Proven experience participating in agile development projects for enterprise-level systems component design and implementation
  • Deep understanding and application of enterprise software design for implementation of data services and middleware.
What your background looks like
  • 5+ years of experience in relevant Streaming/Queueing implementation roles
  • Bachelor degree in Technical discipline; Masters preferred
  • Experience in monitoring the health of Kafka cluster (data loss and data lagging) and strategy for short TTD (time to detect) of broker failure and fast TTR (time to recover)
  • Strong coder who can implement Kafka producers and consumers in various programming languages following the common patterns and best practices
  • Experience in various integration with Kakfa such as Elastic Search, Databases (RDBMS or NoSQL)
  • Experience in Spark stream processing is a plus
  • Experience in RDBMS change log streaming is a plus
  • Systems integration experience, including design and development of APIs, Adapters, and Connectors and Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions.
  • Financial Industry experience preferred
Perks
  • Youll be working in our San Jose office, which is in the heart Santana Row
  • Youll be working in a big data analytic incubator with talented, passionate individuals who are focused on architecting world class cutting edge analytics solutions
  • Four weeks of vacation to start, five sick days and two volunteer days (plus eleven paid holidays)
  • This is a bonus eligible position with a 15% bonus target
  • Employee stock purchase program and 401K matching
  • Wellness initiatives, online discounts, employee discounts, pet insurance and more
EOE including disability/veterans

My Profile

Create and manage profiles for future opportunities.

My Submissions

Track your opportunities.

Similar Listings

San Jose, California, United States

📁 Product Development

Post Date: Aug 20, 2019

© Experian Jobs. All rights reserved. | | |

0 1
Close
Loading...