stdClass Object
(
    [absolute_url] => https://ridecell.com/about/careers/?gh_jid=2419648
    [data_compliance] => Array
        (
            [0] => stdClass Object
                (
                    [type] => gdpr
                    [requires_consent] => 
                    [retention_period] => 
                )

        )

    [internal_job_id] => 1463071
    [location] => stdClass Object
        (
            [name] => Milpitas, CA
        )

    [metadata] => Array
        (
        )

    [id] => 2419648
    [updated_at] => 2020-11-04T09:15:23-05:00
    [requisition_id] => 293
    [title] => Senior Data Infrastructure Engineer, Autonomous Driving
    [content] => <h2><span style="font-weight: 400;">Summary</span></h2>
<p><span style="font-weight: 400;">We are building Nemo - a search engine for automotive data. Nemo extracts relevant events and scenarios from the petabytes of sensor data generated by Connected and Automated Vehicles (CAVs), including those with ADAS and fully autonomous driving systems.&nbsp;</span></p>
<p><span style="font-weight: 400;">We are looking for experienced engineers to design and build our next generation data and cloud infrastructure, to meet the data processing needs of large-scale vehicle fleets.</span></p>
<h2><span style="font-weight: 400;">Responsibilities</span></h2>
<ul>
<li style="font-weight: 400;"><span style="font-weight: 400;">Data pipeline architecture &amp; refactoring</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Data schema optimization (e.g. moving from CSV files to time-indexed columnar storage)</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Designing and implementing a highly scalable data querying and visualization system (e.g. using ElasticSearch and Kibana), architecting data structures for low latency operation&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Database engineering and development of data access libraries</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Automate and script database management tasks</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Design and Build an API (REST/Python/CLI) for data handling, job management, serving processed artifacts, etc.&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Porting local and on-premises software to cloud infrastructure&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Dockerization of data processing software</span></li>
</ul>
<ul>
<li style="font-weight: 400;"><span style="font-weight: 400;">Tune python scripts for performance and efficiency</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">CI/CD setup&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Move a POC product to production level and all that it entails</span></li>
</ul>
<h2><span style="font-weight: 400;">Requirements</span></h2>
<ul>
<li style="font-weight: 400;"><span style="font-weight: 400;">This position requires expertise in data pipeline engineering for potentially massive amounts of structured and unstructured data.</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience with setting up Docker and container management systems like Kubernetes/EKS/ECS</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience with Airflow setup&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience with Docker configuration&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience with infrastructure-as-code (Terraform and CloudFormation) deployment and maintenance</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience with large scale storage systems (cloud and on-prem, NAS).</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience deploying applications to heterogeneous environments: cloud, on-prem (private cloud), and end-user (developer, robot).</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience working with Big Data and strong knowledge of big data infrastructure (e.g., Hadoop, Hive, HDFS, Spark, Elastic Search, AWS Athena)</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience with Apache parquet file based columnar storage&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Good knowledge of common ETL packages / libraries and data ingestion.&nbsp;</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience in setting up ELK Stack (Elasticsearch, Logstash, Kibana stack) to process data from multiple data sources, data analysis for filtering and indexing required data and building interactive Kibana dashboards required</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Experience maintaining systems in AWS (experience with other clouds is a plus). Understand and follow the Well-Architected Framework.</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Programming/Scripting experience in python&nbsp;</span></li>
</ul>
<p>&nbsp;</p>
<p><strong>Technologies Used</strong></p>
<ul>
<li style="font-weight: 400;"><span style="font-weight: 400;">Apache AirFlow, Nifi</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Kubernetes</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Apache Parquet files (columnar storage)</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Codebase primarily in Python, with NumPy, Pandas</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">PostgreSQL with GIS, time-served extensions</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">AWS S3, EC2</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Candidate technologies for scaling up: Apache Hive, ElasticSearch/Kibana, Amazon Athena/EMR</span><span style="font-weight: 400;"><br></span></li>
</ul>
<p><strong>Benefits:</strong></p>
<ul>
<li>401k</li>
<li>Full health, vision, dental benefits</li>
<li>Unlimited PTO</li>
</ul>
    [departments] => Array
        (
            [0] => stdClass Object
                (
                    [id] => 45410
                    [name] => Autonomous Driving Division
                    [child_ids] => Array
                        (
                        )

                    [parent_id] => 
                )

        )

    [offices] => Array
        (
            [0] => stdClass Object
                (
                    [id] => 44887
                    [name] => Milpitas 
                    [location] => Milpitas, California, United States
                    [child_ids] => Array
                        (
                        )

                    [parent_id] => 7054
                )

        )

    [compliance] => Array
        (
            [0] => stdClass Object
                (
                    [type] => eeoc
                    [questions] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [label] => Gender
                                    [fields] => Array
                                        (
                                            [0] => stdClass Object
                                                (
                                                    [name] => gender
                                                    [type] => multi_value_single_select
                                                    [values] => Array
                                                        (
                                                            [0] => stdClass Object
                                                                (
                                                                    [label] => Male
                                                                    [value] => 1
                                                                )

                                                            [1] => stdClass Object
                                                                (
                                                                    [label] => Female
                                                                    [value] => 2
                                                                )

                                                            [2] => stdClass Object
                                                                (
                                                                    [label] => Decline To Self Identify
                                                                    [value] => 3
                                                                )

                                                        )

                                                )

                                        )

                                    [required] => 
                                )

                            [1] => stdClass Object
                                (
                                    [label] => Race
                                    [fields] => Array
                                        (
                                            [0] => stdClass Object
                                                (
                                                    [name] => race
                                                    [type] => multi_value_single_select
                                                    [values] => Array
                                                        (
                                                            [0] => stdClass Object
                                                                (
                                                                    [label] => American Indian or Alaskan Native
                                                                    [value] => 1
                                                                )

                                                            [1] => stdClass Object
                                                                (
                                                                    [label] => Asian
                                                                    [value] => 2
                                                                )

                                                            [2] => stdClass Object
                                                                (
                                                                    [label] => Black or African American
                                                                    [value] => 3
                                                                )

                                                            [3] => stdClass Object
                                                                (
                                                                    [label] => Hispanic or Latino
                                                                    [value] => 4
                                                                )

                                                            [4] => stdClass Object
                                                                (
                                                                    [label] => White
                                                                    [value] => 5
                                                                )

                                                            [5] => stdClass Object
                                                                (
                                                                    [label] => Native Hawaiian or Other Pacific Islander
                                                                    [value] => 6
                                                                )

                                                            [6] => stdClass Object
                                                                (
                                                                    [label] => Two or More Races
                                                                    [value] => 7
                                                                )

                                                            [7] => stdClass Object
                                                                (
                                                                    [label] => Decline To Self Identify
                                                                    [value] => 8
                                                                )

                                                        )

                                                )

                                        )

                                    [required] => 
                                )

                        )

                    [description] => <strong>U.S. Equal Opportunity Employment Information (Completion is voluntary)</strong><br/><p>Individuals seeking employment at this company are considered without regards to race, color, religion, national
origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being
given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment
Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.</p>

<p>Completion of the form is entirely <strong>voluntary</strong>. Whatever your decision, it will not be considered in the hiring
process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.</p>

                )

            [1] => stdClass Object
                (
                    [type] => eeoc
                    [questions] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [label] => VeteranStatus
                                    [fields] => Array
                                        (
                                            [0] => stdClass Object
                                                (
                                                    [name] => veteran_status
                                                    [type] => multi_value_single_select
                                                    [values] => Array
                                                        (
                                                            [0] => stdClass Object
                                                                (
                                                                    [label] => I am not a protected veteran
                                                                    [value] => 1
                                                                )

                                                            [1] => stdClass Object
                                                                (
                                                                    [label] => I identify as one or more of the classifications of a protected veteran
                                                                    [value] => 2
                                                                )

                                                            [2] => stdClass Object
                                                                (
                                                                    [label] => I don't wish to answer
                                                                    [value] => 3
                                                                )

                                                        )

                                                )

                                        )

                                    [required] => 
                                )

                        )

                    [description] => <p>
  If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.
  As a government contractor subject to Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure
  the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories
  is as follows:
</p>
<p>A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.</p>
<p>A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.</p>
<p>An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.</p>
<p>An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.</p>

                )

            [2] => stdClass Object
                (
                    [type] => eeoc
                    [questions] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [label] => DisabilityStatus
                                    [fields] => Array
                                        (
                                            [0] => stdClass Object
                                                (
                                                    [name] => disability_status
                                                    [type] => multi_value_single_select
                                                    [values] => Array
                                                        (
                                                            [0] => stdClass Object
                                                                (
                                                                    [label] => Yes, I have a disability, or have a history/record of having a disability
                                                                    [value] => 1
                                                                )

                                                            [1] => stdClass Object
                                                                (
                                                                    [label] => No, I don't have a disability, or a history/record of having a disability
                                                                    [value] => 2
                                                                )

                                                            [2] => stdClass Object
                                                                (
                                                                    [label] => I don't wish to answer
                                                                    [value] => 3
                                                                )

                                                        )

                                                )

                                        )

                                    [required] => 
                                )

                        )

                    [description] => <strong>Why are you being asked to complete this form?</strong>
<p>Because we do business with the government, we must reach out to, hire, and provide equal opportunity to qualified people with disabilities<sup>1</sup>.  To help us measure how well we are doing, we are asking you to tell us if you have a disability or if you ever had a disability.  Completing this form is voluntary, but we hope that you will choose to fill it out.  If you are applying for a job, any answer you give will be kept private and will not be used against you in any way. </p>
<p>If you already work for us, your answer will not be used against you in any way.  Because a person may become disabled at any time, we are required to ask all of our employees to update their information every five years.  You may voluntarily self-identify as having a disability on this form without fear of any punishment because you did not identify as having a disability earlier.</p>
<strong>How do I know if I have a disability?</strong>
<p>You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.</p>

<p>Disabilities include, but are not limited to:</p>
<ul>
  <li>Blindness</li>
  <li>Deafness</li>
  <li>Cancer</li>
  <li>Diabetes</li>
  <li>Epilepsy</li>
  <li>Autism</li>
  <li>Cerebral palsy</li>
  <li>HIV/AIDS</li>
  <li>Schizophrenia</li>
  <li>Muscular dystrophy</li>
  <li>Bipolar disorder</li>
  <li>Major depression</li>
  <li>Multiple sclerosis (MS)</li>
  <li>Missing limbs or partially missing limbs</li>
  <li>Post-traumatic stress disorder (PTSD)</li>
  <li>Obsessive compulsive disorder</li>
  <li>Impairments requiring the use of a wheelchair</li>
  <li>Intellectual disability (previously called mental retardation)</li>
</ul>

                )

            [3] => stdClass Object
                (
                    [type] => eeoc
                    [questions] => Array
                        (
                        )

                    [description] => <strong>Reasonable Accommodation Notice</strong>
<p>Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities.    Please tell us if you require a reasonable accommodation to apply for a job or to perform your job.  Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.</p>
<p><sup>1</sup>Section 503 of the Rehabilitation Act of 1973, as amended.  For more information about this form or the equal employment obligations of Federal contractors, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at <a href="http://www.dol.gov/ofccp" target="_blank">www.dol.gov/ofccp</a>.</p>
<p>PUBLIC BURDEN STATEMENT:  According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.</p>

                )

        )

    [demographic_questions] => 
    [questions] => Array
        (
            [0] => stdClass Object
                (
                    [description] => 
                    [label] => First Name
                    [required] => 1
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => first_name
                                    [type] => input_text
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [1] => stdClass Object
                (
                    [description] => 
                    [label] => Last Name
                    [required] => 1
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => last_name
                                    [type] => input_text
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [2] => stdClass Object
                (
                    [description] => 
                    [label] => Email
                    [required] => 1
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => email
                                    [type] => input_text
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [3] => stdClass Object
                (
                    [description] => 
                    [label] => Phone
                    [required] => 
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => phone
                                    [type] => input_text
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [4] => stdClass Object
                (
                    [description] => 
                    [label] => Resume/CV
                    [required] => 
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => resume
                                    [type] => input_file
                                    [values] => Array
                                        (
                                        )

                                )

                            [1] => stdClass Object
                                (
                                    [name] => resume_text
                                    [type] => textarea
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [5] => stdClass Object
                (
                    [description] => 
                    [label] => Cover Letter
                    [required] => 
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => cover_letter
                                    [type] => input_file
                                    [values] => Array
                                        (
                                        )

                                )

                            [1] => stdClass Object
                                (
                                    [name] => cover_letter_text
                                    [type] => textarea
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [6] => stdClass Object
                (
                    [description] => 
                    [label] => LinkedIn Profile
                    [required] => 
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => question_20480689
                                    [type] => input_text
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

            [7] => stdClass Object
                (
                    [description] => 
                    [label] => Website
                    [required] => 
                    [fields] => Array
                        (
                            [0] => stdClass Object
                                (
                                    [name] => question_20480690
                                    [type] => input_text
                                    [values] => Array
                                        (
                                        )

                                )

                        )

                )

        )

    [location_questions] => Array
        (
        )

)

Senior Data Infrastructure Engineer, Autonomous Driving

At Ridecell View All Jobs
Milpitas, CA

Summary

We are building Nemo - a search engine for automotive data. Nemo extracts relevant events and scenarios from the petabytes of sensor data generated by Connected and Automated Vehicles (CAVs), including those with ADAS and fully autonomous driving systems. 

We are looking for experienced engineers to design and build our next generation data and cloud infrastructure, to meet the data processing needs of large-scale vehicle fleets.

Responsibilities

  • Data pipeline architecture & refactoring
  • Data schema optimization (e.g. moving from CSV files to time-indexed columnar storage)
  • Designing and implementing a highly scalable data querying and visualization system (e.g. using ElasticSearch and Kibana), architecting data structures for low latency operation 
  • Database engineering and development of data access libraries
  • Automate and script database management tasks
  • Design and Build an API (REST/Python/CLI) for data handling, job management, serving processed artifacts, etc. 
  • Porting local and on-premises software to cloud infrastructure 
  • Dockerization of data processing software
  • Tune python scripts for performance and efficiency
  • CI/CD setup 
  • Move a POC product to production level and all that it entails

Requirements

  • This position requires expertise in data pipeline engineering for potentially massive amounts of structured and unstructured data.
  • Experience with setting up Docker and container management systems like Kubernetes/EKS/ECS
  • Experience with Airflow setup 
  • Experience with Docker configuration 
  • Experience with infrastructure-as-code (Terraform and CloudFormation) deployment and maintenance
  • Experience with large scale storage systems (cloud and on-prem, NAS).
  • Experience deploying applications to heterogeneous environments: cloud, on-prem (private cloud), and end-user (developer, robot).
  • Experience working with Big Data and strong knowledge of big data infrastructure (e.g., Hadoop, Hive, HDFS, Spark, Elastic Search, AWS Athena)
  • Experience with Apache parquet file based columnar storage 
  • Good knowledge of common ETL packages / libraries and data ingestion. 
  • Experience in setting up ELK Stack (Elasticsearch, Logstash, Kibana stack) to process data from multiple data sources, data analysis for filtering and indexing required data and building interactive Kibana dashboards required
  • Experience maintaining systems in AWS (experience with other clouds is a plus). Understand and follow the Well-Architected Framework.
  • Programming/Scripting experience in python 

Technologies Used

  • Apache AirFlow, Nifi
  • Kubernetes
  • Apache Parquet files (columnar storage)
  • Codebase primarily in Python, with NumPy, Pandas
  • PostgreSQL with GIS, time-served extensions
  • AWS S3, EC2
  • Candidate technologies for scaling up: Apache Hive, ElasticSearch/Kibana, Amazon Athena/EMR

Benefits:

  • 401k
  • Full health, vision, dental benefits
  • Unlimited PTO

Apply for the job

Resume/CV Attach PDF | Paste As Text
Cover Letter Attach PDF | Paste As Text