How to Succeed as a Technical PM: Intuit Principal Product Manager Yi Ng Talks Product-Market Fit and Knowledge Engineering
How do you do your taxes? (Aside from begrudgingly, that is.) If you're one of the millions of Americans who files online, you may have used one of the projects that Yi Ng, Principal Product Manager at Intuit, has developed over her eight years at the global financial platform company known for products like TurboTax, QuickBooks, and Mint.
As a Principal PM on the Technology Futures team at Intuit, Yi has a host of responsibilities that span the business, from recruiting and managing a team to envisioning the consumer and small business products of the future. Her role requires her to stay up-to-date on the latest technology so she can manage highly technical products and teams. Currently, she's working on a project called Knowledge Engine (KE) platform, which uses Knowledge Engineering, a field of Artificial Intelligence (AI) that relies on rules devised by human beings.
I sat down with her to discuss her almost 15-year career in product management, her advice for technical product managers, why your product might need more work if customers tell you they like it (seriously), and how knowledge engineering is being leveraged at Intuit.
1. Do you need a tech background to be a technical PM?
The short answer is no, Yi explains, but you do need to understand technology and be passionate about continuous learning.
Yi completed a minor in Computer Science at UC Berkeley, used her coding skills in her first job at a consulting company, and has kept her tech skills sharp to this day. In fact, she organizes professors from UC Berkeley and other experts to give tech talks at Intuit, helping contribute to the continuous learning of a broad constituency at the company.
"I stay close to my engineers and work to maintain a detailed understanding of what the team is working on. Part of that means staying close to the ground and getting your hands dirty," she says. "Having deep technical appreciation is also critical—as is learning how to ask engineers the right questions to fill in gaps in your understanding."
To succeed as a technical PM, keep these 3 tips in mind:
- "Don't be afraid to keep asking questions until you can translate the technical feature in your own words."
- "Take classes in the fields where you lack technical understanding, and attempt to teach other product managers."
- "It's only with high-performing teams that you can really build products that customers will love...."
2. What makes a great PM?
Yi's ideal product manager has 5 key strengths:
- A feel for product and a passion for building awesome products
- An obsession with deeply understanding (and solving) customer pain points
- Technical know-how
- Relationship-building skills
- Excellent communication skills
Product managers come from a number of different fields and backgrounds, so rather than simply assessing past experience, Yi and her team like to ask questions that help them understand how a candidate thinks, prototypes, and makes decisions, such as:
- What information did you actively seek to create the plan and your approach in figuring out the initial pilot?
- What are the critical components of your initial version? How did you select them and why?
- What assumptions are you making that absolutely have to be true for your plan to succeed?
- What assumptions are you planning to test?
- What are the metrics that will determine success?
If you're interviewing at Intuit, keep these tips in mind:
- Always keep the customer in mind. "One question we often ask is: 'Who is the customer, and what is the biggest problem of theirs that you're solving?"
- Use data to make your case. For senior candidates, Yi's team often provides a case study and a couple of days to respond to it. "We're a data-driven company, and we want to see how candidates leverage data," Yi explains.
- Remember that great products need great people. Yi notes that "Product problems are a symptom of organizational problems. How do you go about nurturing your people to build high-performing teams?"
3. How do you assess product-market fit?
Early on in her career at Intuit, Yi was working on a new product that would become Intuit's QuickBooks Self-Employed offering, the fastest growing business at Intuit. She and her team were part of the earliest product phase—discovery of product-market fit— performing rapid and iterative testing of design prototypes with potential customers. The customer problem they were trying to solve: Get sole proprietors organized for tax time. Yi's team started out with the hypothesis that self-employed customers want to keep their personal and business expenses separated, so they designed an initial product around this idea. After a marathon day of testing the new interface with customers, each one said they had liked the product, but their behavior didn't show it.
The team felt something was off. They boldly decided to scrap it and start over. They ran another set of sessions the next day, this time with a new hypothesis centered on enabling the customer to break down business and personal expenses according to percentages and amounts. This time around, customers weren't just saying that they liked the product. They loved it.
"They were saying, 'Oh my gosh, can I pay you $100 a month to have this now?'" says Yi, smiling. The story underscores a common experience during early stage product management, where neither the customer nor the product team is able to fully articulate the customer need. Yi credits the success of that experience to Design 4 Delight, a process Intuit considers their "secret sauce," which entails deep customer empathy to develop a design that can be rapidly tested until arriving at a solution that adequately solves the customer's need—to the point where they fall in love with the product. For Yi, "That experience on QuickBooks Self-Employed was an example of how it's very different when you actually find that product-market fit—and how important it is to have a trusting environment with your team where everyone feels comfortable voicing their ideas and responding to feedback. Ultimately a fantastic product is a reflection of a high-performing team."
Her takeaways about building the right product:
- Build a high-performing team.
- Understand customer needs.
- Know what you can solve well.
- Keep pushing until you're sure you have identified and solved the customer's biggest problem.
4. What is knowledge engineering? How is it being used at Intuit?
One of the most essential parts of any PM's role is keeping up with the latest tech trends. For Yi, this is what keeps the job exciting — and to excel in her current role, she's taken a deep dive into knowledge engineering.
Unlike Machine Learning, which takes a bottom-up approach to implementing A.I.by enabling systems to learn and improve from experience without explicit programming, Knowledge Engineering takes a top to bottom approach, translating vast human knowledge (like tax code, in Intuit's case) into a rules-based system.
"Data-driven machine learning looks at large sets of data and derives insights that humans may or may not have," says Yi. "Knowledge engineering starts from the other side. We humans have a lot of knowledge and logic in our heads already—how can we translate that knowledge so we can leverage its benefits?"
Intuit's particular emphasis on knowledge engineering is due to the critical nature of its applications: personal and business taxes, payroll, and financial compliance in general. Because of this, the company's consumer, small business, and self-employed customers expect precise and logically interconnected results with a clear and personalized explanation of why the system provided a particular response or recommendation.
Yi explains that Intuit's Knowledge Engine (KE) platform leverages this in 2 main ways:
1. Accuracy + Explainability: KE enables Intuit software to not only show customers what their expected financial outcome is, but why.
Have you ever finished filling out your taxes online, seen your expected refund, and wondered how the product got to that exact number? With KE, TurboTax intrinsically correlates and intertwines more than 80,000 pages of U.S. tax code to deliver an accurate, contextual explanation for how, given your particular financial situation, your refund was calculated. Given that 55% of Americans don't feel confident about their finances, providing this explanation is a vital part of educating customers and building trust.
TurboTax's ExplainWhy Feature in Action
2. Personalized experiences: KE can create unique interfaces based on tailored situations, providing each user with a personalized product experience without developers having to code tens of thousands of screens to account for every possibility.
"What the Knowledge Engine does really well is surface the right question at the right time, to create an experience tailored just for you. This is possible because Knowledge Engine takes complex compliance rules such as taxes or accounting, and codifies and translates them into an experience that's tailored to your situation." says Yi.
"Imagine you have a student in your household who is about to turn 18 and needs to apply for student loans. With KE, we can use a combination of rules and insights to streamline this process for our customers so that they don't have to answer as many questions or manually input data that they have already confirmed in TurboTax to qualify for a loan."
Speaking as someone intimately familiar with the current inane, frustrating process of applying for student loans…sign me up!
If you have further questions for Yi on product management, let her know in the comments! And if you're interested in working in Product Management at Intuit, check out these jobs: Product Manager positions at Intuit.
I sat in front of my CEO to discuss several complaints of racism. I was new to my role as a Culture Director. I was nervous about his reaction to the complaints. But I also knew he strongly supported developing this new department; I knew that he would take the right steps. So I was shocked when I heard him say sheepishly, "I don't know, Noelle...all of this stuff about racism. I just don't see it. I don't even see color. I'm pretty much color blind."
Living in the midst of a pandemic has brought about a whole host of changes and challenges for workplaces and employees. One of the most notable? Virtual interviewing. With most on-site interviews on hold for the foreseeable future, it's important that you be prepared to make a great first impression—virtually.
A five-step framework for addressing systematic racism at work
The world has changed in the past few weeks.
We're watching corporations and organizations across the world come out in support of Black lives in droves. Many of those organizations are doing so for the first time in their history.
Women Founders & CEOs Share Their Tips
If you're anxious about looking for a new job right now, you're not alone. We've talked before about how you can land a job in the midst of COVID-19, but today we wanted to share advice from some of the experts who spoke at our inaugural Diversity Reboot Summit.
If you're struggling with perfectionism:<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="824ce73e30a279a266a5dd91047dd6f5"><iframe lazy-loadable="true" src="https://www.youtube.com/embed/y58Luzbv_vw?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span><p><em>Reshma Saujani is the Founder and CEO of Girls Who Code, the international nonprofit organization working to close the gender gap in technology and change the image of what a computer programmer looks like and does. Since her viral TED Talk, "Teach Girls Bravery, Not Perfection" resonated worldwide, Reshma has been on a mission to inspire women to leave socially-ingrained perfectionism behind and rewire themselves for braver, bolder lives. Reshma talked with Zeryn Sarpangal, Chief Financial and People Officer, Code For America, about how women can work to be brave, not perfect, as they look for new opportunities. </em></p>
If you're looking to pivot into tech (and land a remote job):<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="80353e84513d2d043db309aaa94d457a"><iframe lazy-loadable="true" src="https://www.youtube.com/embed/ZaPMxG_5C40?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span><p><em>Adda Birnir, CEO of Skillcrush, shares her tips for getting the skills you need to land a remote job, even if you don't have a tech background. Skillcrush is an online tech-education company that helps their women make a career change into tech. </em></p>
If you need an inside connection:<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="e38baadbe67361bff0eb4b95a5d2ade3"><iframe lazy-loadable="true" src="https://www.youtube.com/embed/gjK8kjosZe8?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span><p><em>How will we connect with others professionally as social distancing continues? During this session, Kristy Wallace, CEO of Ellevate Network; Natasha Green, Sr. Local Communities Manager at AnitaB.org Initiative; and Dee Poku-Spalding, Founder and CEO of WIE (Women: Inspiration and Enterprise) share their expert networking advice with Organized SHIFT CEO Landi Spearman.</em></p>
Since the brutal murder of George Floyd, the demand to take a strong stance against racism has swept the nation.