In this blog, drawing from my conversation with Krishna Mohan Gadi (Head of Products at Porter), I explore proven strategies, methodologies, and real-world examples to help product managers and business leaders navigate this complex landscape.

Building a product that scales effectively while addressing market fit is no easy feat. The journey from ideation to a market-validated, scalable product involves careful balancing of qualitative insights and quantitative metrics. This blog explores proven strategies, methodologies, and real-world examples to help product managers and business leaders navigate this complex landscape.

The Importance of Qualitative Research

Understanding customer behavior and identifying pain points requires delving into the qualitative realm. While data analytics provide an overarching view, qualitative research gives depth and clarity to user needs, enabling teams to understand behavioral patterns.

Data often guides where is the problem but not always the why behind it and that’s where qualitative research is very helpful.

For instance, through data we can figure out at which steps in the user journey there are drops in the conversion funnel but to understand why is this happening, the answer usually lies in qualitative research. Especially for tougher problems like retention, this is even more true.

Why Qualitative Research Matters:

1. Behavioral Insights: Observing user interactions reveals latent needs and pain points that numbers can’t always capture.
2. Contextual Understanding: Engaging directly with users allows teams to uncover cultural, socioeconomic, and psychological factors influencing decisions.
3. Hypothesis Formation: Qualitative inputs often guide hypothesis creation, laying the groundwork for validation through A/B testing.

For instance, for a leading K-12 online live learning platform the conversion rate for girls as a student persona was much higher than that of boys everything else being equal. While data showed this trend, the real insight came from conversations with students (girls and boys) and their parents. It turns out that most parents in smaller towns aren’t as comfortable sending their daughters to larger cities which are coaching centre hubs for JEE/NEET. Thus online learning has better adoption in this TG. This insight informed targeted interventions to double down (acquisition -> conversion -> retention) on the better converting girl child TG while coming up with a different strategy for addressing the concerns of boys and their parents.

The Role of Quantitative Metrics

Quantitative data offers precision. It allows teams to measure the impact of their interventions and make data-driven decisions. However, this approach is most effective when paired with robust qualitative insights.

Steps to Leverage Quantitative Data:

1. Identify Key Metrics: Define the primary metrics (L0), break down into secondary and tertiary metrics (L1, L2 etc.) and check metrics as guardrails. Use these metrics to track progress. Define thresholds for better decision making.
2. Validate at Scale: Use large (as appropriate) datasets to confirm hypotheses formed during qualitative research. Account for biases during qual/quant research as well as during the experimentation phase.
3. Iterate Based on Insights: Regularly revisit and refine metrics to ensure alignment with evolving business goals.

For example, for a food delivery company (this is also true for most marketplaces) there are multiple factors that affect conversion rate such as quality of supply, quantity of supply, prices/discounts, quality of demand (users), quality of recommendations/personalization etc. Using a combination of user research and data driven analysis we were able to tease apart the impact of each of these factors on the primary metric.

User research helped in
a) casting a wider net i.e. coming up with more hypothesis — some blind spots were uncovered and helped us identify more factors which the team had not initially considered
b) prioritization of our top hypothesis — validating some of our hypothesis and sharpening our focus areas
These hypothesis were then validated by a series of experiments and robust analysis over a period of time.

These insights helped not only in moving conversion rate but also creating a stronger flywheel for the marketplace by pairing the right demand with the right supply.

Research and data driven analysis are like Yin-Yang. Depending on the stage in the lifecycle of the product and parameters like nature of the problem, complexity of the problem and criticality of the problem the interplay of the Yin-Yang becomes very dynamic.

At early stages in the PMF journey, the reliance on qualitative research is much higher and as the product matures there is sufficient data to make more nuanced optimization decisions at scale on the back of this data supported by research.

Designing Research Frameworks

Effective research frameworks are essential for understanding and addressing user needs. Two key methodologies are generative research and evaluative research:

1. Generative Research (focused on the problem space):

• Explores user needs and the underlying motivations and habits
• Helps in identifying opportunities to solve user problems

2. Evaluative Research (focused on the solution space):

• Focuses on whether the solution meets users’ expectations in solving a specific problem
• Carried out at later stages in the product development life cycle

In the problem phase, generative research techniques are used to understand the problem well which is followed by engaging in some concept testing (often through prototypes) to determine whether the concept is resonating with users. This then makes way into a set of proposed solutions which are again validated with users using a variety of evaluative research techniques. This iterative approach which involves constantly gathering feedback on potential approaches, is a critical step in refining product direction.

Balancing Intuition and Data

Product decisions often require a mix of intuition and data-driven analysis. While data provides structure and direction, intuition — developed through experience — adds a nuanced layer of decision-making.

Building Intuition:

1. Learn from Successes and Failures: Regularly analyze outcomes as well as the process that led to these outcomes to identify patterns and improve decision-making.
2. Seek Diverse Perspectives: Engage with peers and mentors to broaden your understanding. There is also a lot of literature now available on the internet to broaden your horizon.
3. Develop Gut Calls: Treat intuition as a muscle that strengthens with exposure to various challenges.

For example, product managers often face “two-way door” decisions — choices with low costs of mistakes. These situations are ideal for relying on intuition, especially when there’s no clear thesis.

By limiting the blast radius, one can create a playing field where intuition can be exercised more often followed by introspection. This helps product managers hone their intuition over time.

In conclusion, achieving a scalable product that resonates with the market is a multifaceted challenge that demands a harmonious blend of qualitative insights and quantitative data. As we’ve explored, qualitative research plays a crucial role in uncovering the underlying motivations and pain points of users, providing depth to the numerical trends identified through quantitative analysis. This dual approach not only informs hypothesis formation but also enhances the decision-making process, allowing product managers to craft targeted strategies that address diverse user needs.

The iterative nature of research — balancing generative and evaluative methodologies — ensures that teams remain agile and responsive to user feedback throughout the product lifecycle. Furthermore, cultivating intuition alongside data-driven strategies empowers product leaders to make informed decisions, particularly in ambiguous situations. By embracing this dynamic interplay of insights and metrics, businesses can effectively navigate the complexities of scaling their products while ensuring they meet the evolving demands of their target markets. Ultimately, the journey towards market fit is not just about numbers; it’s about understanding and connecting with users on a deeper level to foster lasting engagement and success.