Product Manager, Experimentation - The Roku Channel
Employment Type: Full-Time
We don't just love TV. We are TV.
Roku is changing how the world watches TV
Roku is the #1 TV streaming platform in the US. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers.
From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers worldwide while gaining meaningful experience across various disciplines.
About the team
Over the last few years, The Roku Channel (TRC) has become a leading streaming app for free, live, and subscription-based premium content, ensuring that a great streaming experience is a click away, whether you are in your living room, on your mobile, or at your desktop. As of 2021, TRC is already reaching U.S. households with an estimated 70 million people.
The Programming organization focuses on expanding the scale, reach and content offering of TRC through partnerships with over 175 different content providers. In 2021, we launched Roku Originals and acquired This Old House to enable new ways to provide our users with great content. In addition to TRC, we also build new experiences and tools that help users find content like Featured Free and Roku Recommends. We collaborate across many teams to deliver great content, drive engagement, and delight millions of TV streamers worldwide.
About the Role
At 'The Roku Channel', we are on a path to making experimentation and data-informed decision-making a part of our DNA. We use our in-house experimentation platform to execute 100s of AB tests across product, editorial and marketing teams. The goal is to democratize AB testing as a tool to bring consumer voices in business and product decision-making. The role requires a hands-on and data fluent individual experienced in - Consumer/ UI AB testing at scale, Software development processes, and Experimentation/ Data platforms.
As the Experimentation PM for The Roku Channel group, you will collaborate with Business leads, Product Managers, and Engg leads in helping them grow their respective areas via high-impact experiments. The scope of experiments will include AVOD, SVOD, Live/Linear, Browse UI, ML Recommendations, and more. You will use supporting data and customer research to evaluate and prioritize test hypotheses, then work with leads to design and execute tests that will prove or disprove the hypotheses. As the experimentation champion, your inputs will help shape our core Experimentation platform to the next level.
You will be responsible for the prioritization, planning, managing, and execution of AB tests and features from ideation to feature launch decision. You will maintain an experiment idea backlog for The Roku Channel and grooming the top ideas. Your Experimentation roadmap will have a prioritized list of initiatives across new AB tests, self-serve tooling, and experimentation scaling across all UI touchpoints. At the execution level - you will translate and detail the consumer, business, and platform requirements for tests. You will help identify potential test conflicts across all Roku experiments and plan to mitigate risk. You are expected to drive regular check-ins with cross-functional teams to unblock and track status.
Success in the role will require you to navigate cross-functionally, identifying lightweight ways to do early validation, and use your storytelling skills to present the AB test analysis and get a go/ no go consensus. You are expected to closely monitor AB tests daily and provide regular AB testing status. After the test completion, you will conduct the data analysis using existing tools and present the learnings. You will be working closely with Analytics for detailed analysis and new feature data logging requirements. This is an excellent role for someone genuinely excited about launching high-quality product experiences and grow their engagement growth experimentation chops with test fast, learn fast, and iterate framework.
We're excited if you have
* 4+ years of Product Management experience in Experimentation, Growth, or UI optimization.
* Thrives in a team that believes in working fast, being accountable, and iterate fast based on learning.
* Strong data-driven storytelling skills and presenting to a wide range of stakeholders.
* Hands-on experience in executing A/B and multivariate tests and delivered KPI improvements.
* Drive formulation of measurable hypotheses, logging requirements, and KPI selection.
* Fluent in exploring data sets and conducting data analysis (MySQL, Looker, etc.)
* Must enjoy and work well with a wide variety of stakeholders in a complex organization.
* Tactically manage test layer space constraints, test collision avoidance, and validity of results.
* Nimble and flexible with regards to changing priorities & business needs.
* Proven multi-tasking skills, ability to meet critical deadlines.
* Relentlessly focused on delivery and understand the value of getting MVPs and products out the door.
* Minimum of a bachelor's degree (preferably in Computer Science or Statistics), MBA a plus.
The Roku Culture
Roku is a great place for people who want to work in a fast-paced environment where everyone is focused on the company's success rather than their own. We try to surround ourselves with people who are great at their jobs, who are easy to work with, and who keep their egos in check. We appreciate a sense of humor. We believe a fewer number of very talented folks can do more for less cost than a larger number of less talented teams. We're independent thinkers with big ideas who act boldly, move fast and accomplish extraordinary things through collaboration and trust. In short, at Roku, you'll be part of a company that's changing how the world watches TV.
We have a unique culture that we are proud of. We think of ourselves primarily as problem-solvers, which itself is a two-part idea. We come up with the solution, but the solution isn't real until it is built and delivered to the customer. That penchant for action gives us a pragmatic approach to innovation, one that has served us well since 2002.