Lead Data Engineer
The Center for New Data | Remote | Permanent
Lead Data Engineer
The Center for New Data | Remote | Permanent
Position Summary
Organization Overview
The Center for New Data is a non-partisan non-profit organization dedicated to unlocking the power of novel data by the people and for the people. Founded in a burst of creativity at the start of the COVID pandemic, the Center has built an innovative cloud computing platform, amassed millions of dollars of donated data and technology, and developed trusted partnerships with top universities, voting rights, and media organizations. Together, these power bold equity-focused social impact projects are executed in partnership with our high-skilled volunteer data corps.
Our current programs focus on fighting voter suppression and gerrymandering, leveraging location data from 35 million mobile devices across the country. Our work has been profiled by The New York Times, Fast Company, and many high profile publications; introduced as testimony to the U.S. Congress and state legislatures by groups like Stacey Abrams and the NAACP; supported investigative features by the Washington Post and Center for Public Integrity; and helped reopen two polling locations in Georgia’s Senate Runoff election, which tipped the balance of the Senate.
We are constantly finding new ways to unlock novel data to benefit the national policy discussion and build towards a more healthy, fair, and equitable world.
Why work at the Center for New Data?
- Get the best of both the nonprofit and startup worlds: a fun, entrepreneurial, creative environment where you can directly shape the future of a new organization — while also doing mission-aligned work, fighting for social impact, and a more equitable nation.
- Contribute to the fight for a more fair democracy and a healthier and more just nation.
- Shape national headlines, legislation, and litigation.
- Work alongside leading universities, nonprofit advocacy orgs, and media organizations.
- Drive innovation — both technical and political.
- Rapid career growth, taking on new technical and leadership challenges.
Position Overview
As the Center’s Lead Data Engineer, you will:
Drive innovation and strategy
- Shape the strategic direction of the organization, providing a technical perspective to complement the existing leadership team.
- Drive innovative uses of data and technology connected to social impact areas.
Oversee infrastructure
- Develop a technology roadmap in collaboration with the Executive Director.
- Oversee the design and general effectiveness of technical and data infrastructure (supported by industry-leading data engineer, science, and architect volunteers).
- Critically review technical operations and programs, ensuring it’s appropriately broken down and prioritized across the organization.
Manage data engineering and/or social impact projects
- Ideate, scope, and manage projects in collaboration with leadership & volunteers.
- Organize and support cross-functional teams of volunteers.
- Make high-level technical decisions and/or work with volunteers to implement decisions designed to improve data pipelines, scale analysis, and streamline technical operations.
We are a nimble and growing team, focused on elevating and training ourselves and our volunteers. You will report to the Executive Director, joining a team of three. There are endless opportunities to build reports, interact with stakeholders, provide leadership, and advance your career.
The position will start as a 1099 contractor, with an option to transition to W-2 employment.
Skills and Qualifications
You most likely have:
Mindset and Motivation
- A strong desire to use your creative, technical, strategic, and leadership skills to make an impact on society.
- A strong desire for working in an entrepreneurial and creative setting.
- A strong desire to work alongside high-skill, high-motivation data volunteers, learning from some and mentoring others, and contributing to a sense of community for all.
- Interest in being a member of a diverse, multidisciplinary team, engaging with stakeholders across race, ethnicity, sexual orientation, gender, age, and class.
- Strong communication and collaboration skills.
Technical Skills
- 2+ years of data engineering and ETL processing experience
- Experience in standard data engineering or large system design, including:
- Airflow, Pachyderm, or equivalent modern data scheduling and execution framework, with an emphasis on best practices in Python and SQL on distributed datastores.
- Standard SQL, including advanced aspects like query optimization, indexing, common table expressions, window functions, materialized views, and the merge statement.
- Design patterns in ETL (e.g. dimensional modeling, insert vs truncate).
- Snowflake, Redshift, BigQuery, or similar large-scale distributed datastore experience.
- Cloud-heavy environments like AWS that leverage S3 and distributed file systems.
You might have:
Mindset and Motivation
- Experience and interest in using data for storytelling, for social impact projects, or in relation to public policy research.
- A strong interest specifically in areas of voting rights, social determinants of health, and advancing racial and socioeconomic equality.
Technical Skills
- Experience organizing and running cross-functional teams.
- Experience with implementing and thinking critically about machine learning models.
- A record of success in product, Back-End, DevOps, Data Science, and Security teams.
- Familiarity with DataBricks, Spark, and PySpark.
Date Posted
08/17/21
Job Role
Analytics, Data & Data Management, Engineer, Executive, Management, Technology
Location
Remote
Salary
How to Apply
Position Summary
Organization Overview
The Center for New Data is a non-partisan non-profit organization dedicated to unlocking the power of novel data by the people and for the people. Founded in a burst of creativity at the start of the COVID pandemic, the Center has built an innovative cloud computing platform, amassed millions of dollars of donated data and technology, and developed trusted partnerships with top universities, voting rights, and media organizations. Together, these power bold equity-focused social impact projects are executed in partnership with our high-skilled volunteer data corps.
Our current programs focus on fighting voter suppression and gerrymandering, leveraging location data from 35 million mobile devices across the country. Our work has been profiled by The New York Times, Fast Company, and many high profile publications; introduced as testimony to the U.S. Congress and state legislatures by groups like Stacey Abrams and the NAACP; supported investigative features by the Washington Post and Center for Public Integrity; and helped reopen two polling locations in Georgia’s Senate Runoff election, which tipped the balance of the Senate.
We are constantly finding new ways to unlock novel data to benefit the national policy discussion and build towards a more healthy, fair, and equitable world.
Why work at the Center for New Data?
- Get the best of both the nonprofit and startup worlds: a fun, entrepreneurial, creative environment where you can directly shape the future of a new organization — while also doing mission-aligned work, fighting for social impact, and a more equitable nation.
- Contribute to the fight for a more fair democracy and a healthier and more just nation.
- Shape national headlines, legislation, and litigation.
- Work alongside leading universities, nonprofit advocacy orgs, and media organizations.
- Drive innovation — both technical and political.
- Rapid career growth, taking on new technical and leadership challenges.
Position Overview
As the Center’s Lead Data Engineer, you will:
Drive innovation and strategy
- Shape the strategic direction of the organization, providing a technical perspective to complement the existing leadership team.
- Drive innovative uses of data and technology connected to social impact areas.
Oversee infrastructure
- Develop a technology roadmap in collaboration with the Executive Director.
- Oversee the design and general effectiveness of technical and data infrastructure (supported by industry-leading data engineer, science, and architect volunteers).
- Critically review technical operations and programs, ensuring it’s appropriately broken down and prioritized across the organization.
Manage data engineering and/or social impact projects
- Ideate, scope, and manage projects in collaboration with leadership & volunteers.
- Organize and support cross-functional teams of volunteers.
- Make high-level technical decisions and/or work with volunteers to implement decisions designed to improve data pipelines, scale analysis, and streamline technical operations.
We are a nimble and growing team, focused on elevating and training ourselves and our volunteers. You will report to the Executive Director, joining a team of three. There are endless opportunities to build reports, interact with stakeholders, provide leadership, and advance your career.
The position will start as a 1099 contractor, with an option to transition to W-2 employment.
Skills and Qualifications
You most likely have:
Mindset and Motivation
- A strong desire to use your creative, technical, strategic, and leadership skills to make an impact on society.
- A strong desire for working in an entrepreneurial and creative setting.
- A strong desire to work alongside high-skill, high-motivation data volunteers, learning from some and mentoring others, and contributing to a sense of community for all.
- Interest in being a member of a diverse, multidisciplinary team, engaging with stakeholders across race, ethnicity, sexual orientation, gender, age, and class.
- Strong communication and collaboration skills.
Technical Skills
- 2+ years of data engineering and ETL processing experience
- Experience in standard data engineering or large system design, including:
- Airflow, Pachyderm, or equivalent modern data scheduling and execution framework, with an emphasis on best practices in Python and SQL on distributed datastores.
- Standard SQL, including advanced aspects like query optimization, indexing, common table expressions, window functions, materialized views, and the merge statement.
- Design patterns in ETL (e.g. dimensional modeling, insert vs truncate).
- Snowflake, Redshift, BigQuery, or similar large-scale distributed datastore experience.
- Cloud-heavy environments like AWS that leverage S3 and distributed file systems.
You might have:
Mindset and Motivation
- Experience and interest in using data for storytelling, for social impact projects, or in relation to public policy research.
- A strong interest specifically in areas of voting rights, social determinants of health, and advancing racial and socioeconomic equality.
Technical Skills
- Experience organizing and running cross-functional teams.
- Experience with implementing and thinking critically about machine learning models.
- A record of success in product, Back-End, DevOps, Data Science, and Security teams.
- Familiarity with DataBricks, Spark, and PySpark.
Lead Data Engineer
The Center for New Data | Remote | Permanent
Position Summary
Organization Overview
The Center for New Data is a non-partisan non-profit organization dedicated to unlocking the power of novel data by the people and for the people. Founded in a burst of creativity at the start of the COVID pandemic, the Center has built an innovative cloud computing platform, amassed millions of dollars of donated data and technology, and developed trusted partnerships with top universities, voting rights, and media organizations. Together, these power bold equity-focused social impact projects are executed in partnership with our high-skilled volunteer data corps.
Our current programs focus on fighting voter suppression and gerrymandering, leveraging location data from 35 million mobile devices across the country. Our work has been profiled by The New York Times, Fast Company, and many high profile publications; introduced as testimony to the U.S. Congress and state legislatures by groups like Stacey Abrams and the NAACP; supported investigative features by the Washington Post and Center for Public Integrity; and helped reopen two polling locations in Georgia’s Senate Runoff election, which tipped the balance of the Senate.
We are constantly finding new ways to unlock novel data to benefit the national policy discussion and build towards a more healthy, fair, and equitable world.
Why work at the Center for New Data?
- Get the best of both the nonprofit and startup worlds: a fun, entrepreneurial, creative environment where you can directly shape the future of a new organization — while also doing mission-aligned work, fighting for social impact, and a more equitable nation.
- Contribute to the fight for a more fair democracy and a healthier and more just nation.
- Shape national headlines, legislation, and litigation.
- Work alongside leading universities, nonprofit advocacy orgs, and media organizations.
- Drive innovation — both technical and political.
- Rapid career growth, taking on new technical and leadership challenges.
Position Overview
As the Center’s Lead Data Engineer, you will:
Drive innovation and strategy
- Shape the strategic direction of the organization, providing a technical perspective to complement the existing leadership team.
- Drive innovative uses of data and technology connected to social impact areas.
Oversee infrastructure
- Develop a technology roadmap in collaboration with the Executive Director.
- Oversee the design and general effectiveness of technical and data infrastructure (supported by industry-leading data engineer, science, and architect volunteers).
- Critically review technical operations and programs, ensuring it’s appropriately broken down and prioritized across the organization.
Manage data engineering and/or social impact projects
- Ideate, scope, and manage projects in collaboration with leadership & volunteers.
- Organize and support cross-functional teams of volunteers.
- Make high-level technical decisions and/or work with volunteers to implement decisions designed to improve data pipelines, scale analysis, and streamline technical operations.
We are a nimble and growing team, focused on elevating and training ourselves and our volunteers. You will report to the Executive Director, joining a team of three. There are endless opportunities to build reports, interact with stakeholders, provide leadership, and advance your career.
The position will start as a 1099 contractor, with an option to transition to W-2 employment.
Skills and Qualifications
You most likely have:
Mindset and Motivation
- A strong desire to use your creative, technical, strategic, and leadership skills to make an impact on society.
- A strong desire for working in an entrepreneurial and creative setting.
- A strong desire to work alongside high-skill, high-motivation data volunteers, learning from some and mentoring others, and contributing to a sense of community for all.
- Interest in being a member of a diverse, multidisciplinary team, engaging with stakeholders across race, ethnicity, sexual orientation, gender, age, and class.
- Strong communication and collaboration skills.
Technical Skills
- 2+ years of data engineering and ETL processing experience
- Experience in standard data engineering or large system design, including:
- Airflow, Pachyderm, or equivalent modern data scheduling and execution framework, with an emphasis on best practices in Python and SQL on distributed datastores.
- Standard SQL, including advanced aspects like query optimization, indexing, common table expressions, window functions, materialized views, and the merge statement.
- Design patterns in ETL (e.g. dimensional modeling, insert vs truncate).
- Snowflake, Redshift, BigQuery, or similar large-scale distributed datastore experience.
- Cloud-heavy environments like AWS that leverage S3 and distributed file systems.
You might have:
Mindset and Motivation
- Experience and interest in using data for storytelling, for social impact projects, or in relation to public policy research.
- A strong interest specifically in areas of voting rights, social determinants of health, and advancing racial and socioeconomic equality.
Technical Skills
- Experience organizing and running cross-functional teams.
- Experience with implementing and thinking critically about machine learning models.
- A record of success in product, Back-End, DevOps, Data Science, and Security teams.
- Familiarity with DataBricks, Spark, and PySpark.
Lead Data Engineer
The Center for New Data | Remote | Permanent
Position Summary
Organization Overview
The Center for New Data is a non-partisan non-profit organization dedicated to unlocking the power of novel data by the people and for the people. Founded in a burst of creativity at the start of the COVID pandemic, the Center has built an innovative cloud computing platform, amassed millions of dollars of donated data and technology, and developed trusted partnerships with top universities, voting rights, and media organizations. Together, these power bold equity-focused social impact projects are executed in partnership with our high-skilled volunteer data corps.
Our current programs focus on fighting voter suppression and gerrymandering, leveraging location data from 35 million mobile devices across the country. Our work has been profiled by The New York Times, Fast Company, and many high profile publications; introduced as testimony to the U.S. Congress and state legislatures by groups like Stacey Abrams and the NAACP; supported investigative features by the Washington Post and Center for Public Integrity; and helped reopen two polling locations in Georgia’s Senate Runoff election, which tipped the balance of the Senate.
We are constantly finding new ways to unlock novel data to benefit the national policy discussion and build towards a more healthy, fair, and equitable world.
Why work at the Center for New Data?
- Get the best of both the nonprofit and startup worlds: a fun, entrepreneurial, creative environment where you can directly shape the future of a new organization — while also doing mission-aligned work, fighting for social impact, and a more equitable nation.
- Contribute to the fight for a more fair democracy and a healthier and more just nation.
- Shape national headlines, legislation, and litigation.
- Work alongside leading universities, nonprofit advocacy orgs, and media organizations.
- Drive innovation — both technical and political.
- Rapid career growth, taking on new technical and leadership challenges.
Position Overview
As the Center’s Lead Data Engineer, you will:
Drive innovation and strategy
- Shape the strategic direction of the organization, providing a technical perspective to complement the existing leadership team.
- Drive innovative uses of data and technology connected to social impact areas.
Oversee infrastructure
- Develop a technology roadmap in collaboration with the Executive Director.
- Oversee the design and general effectiveness of technical and data infrastructure (supported by industry-leading data engineer, science, and architect volunteers).
- Critically review technical operations and programs, ensuring it’s appropriately broken down and prioritized across the organization.
Manage data engineering and/or social impact projects
- Ideate, scope, and manage projects in collaboration with leadership & volunteers.
- Organize and support cross-functional teams of volunteers.
- Make high-level technical decisions and/or work with volunteers to implement decisions designed to improve data pipelines, scale analysis, and streamline technical operations.
We are a nimble and growing team, focused on elevating and training ourselves and our volunteers. You will report to the Executive Director, joining a team of three. There are endless opportunities to build reports, interact with stakeholders, provide leadership, and advance your career.
The position will start as a 1099 contractor, with an option to transition to W-2 employment.
Skills and Qualifications
You most likely have:
Mindset and Motivation
- A strong desire to use your creative, technical, strategic, and leadership skills to make an impact on society.
- A strong desire for working in an entrepreneurial and creative setting.
- A strong desire to work alongside high-skill, high-motivation data volunteers, learning from some and mentoring others, and contributing to a sense of community for all.
- Interest in being a member of a diverse, multidisciplinary team, engaging with stakeholders across race, ethnicity, sexual orientation, gender, age, and class.
- Strong communication and collaboration skills.
Technical Skills
- 2+ years of data engineering and ETL processing experience
- Experience in standard data engineering or large system design, including:
- Airflow, Pachyderm, or equivalent modern data scheduling and execution framework, with an emphasis on best practices in Python and SQL on distributed datastores.
- Standard SQL, including advanced aspects like query optimization, indexing, common table expressions, window functions, materialized views, and the merge statement.
- Design patterns in ETL (e.g. dimensional modeling, insert vs truncate).
- Snowflake, Redshift, BigQuery, or similar large-scale distributed datastore experience.
- Cloud-heavy environments like AWS that leverage S3 and distributed file systems.
You might have:
Mindset and Motivation
- Experience and interest in using data for storytelling, for social impact projects, or in relation to public policy research.
- A strong interest specifically in areas of voting rights, social determinants of health, and advancing racial and socioeconomic equality.
Technical Skills
- Experience organizing and running cross-functional teams.
- Experience with implementing and thinking critically about machine learning models.
- A record of success in product, Back-End, DevOps, Data Science, and Security teams.
- Familiarity with DataBricks, Spark, and PySpark.