#148 - How to Design Your PhD Methodology: The 6-Step Methodology Compass Framework

P.S. I'm live in the comments under every LinkedIn post on Mon, Tue, Thu and Sat from 2:34pm GMT. Drop by if you want to dig into the topic, ask a question, or just say hello.

Why Most Methodology Chapters Fall Apart

Here is what most candidates do not understand until it is too late: your methodology is not your methods.

Your methods are the tools you use to collect data.

Your methodology is the rationale that explains why those tools are the right ones for your question.

An examiner does not just want to know that you used semi-structured interviews.

They want to know why interviews and not a survey.

• Why semi-structured and not unstructured.
• Why twenty participants and not fifty.
• Why thematic analysis and not grounded theory.

Every single choice needs a reason, and those reasons need to connect to each other like links in a chain.

If one link breaks, the whole chapter comes into question.

The problem is that most candidates build this chain backwards.

They start with the methods they feel comfortable with and then try to find a philosophy and a design that justify those methods after the fact.

Examiners see through this every time.

A methodology chapter that was built backwards reads differently from one that was built in order, and by the time you reach the viva, it is very difficult to defend choices you made for the wrong reasons.

The Methodology Compass: 6 Steps in the Right Order

I call this the Methodology Compass because it gives you direction.

Each step has one job. You do not start the next one until the current one is done. Skip a step or do them out of order and your chapter will show it.

The six steps fall into three phases: Foundation, Design, and Execution.

FOUNDATION

Step 1: Define the gap and research question.

Everything starts here. Not with a topic or an interest, but with a question.

Most candidates come to me with a topic: "I want to study smart homes for older people" or "I am interested in leadership in healthcare."

That is a starting point, not a research question.

A research question commits your study to a finding.

It tells the reader what you are going to investigate, who you are investigating it with, and what kind of answer you expect to find.

Let me show you the difference using an example I walk through with mentees.

A candidate comes in with this: "Improving the quality of life of older people through smart home products." That is a topic.

After working through the question properly, it becomes:

"How can smart home products support the quality of life of older adults living independently?"

Now we have something that points to a specific study with a specific population and a specific outcome.

If your question is vague, every step after it will be vague too.

Get this right and the rest of the framework gets easier.

Get it wrong and nothing downstream will fix it.

Step 2: Establish your philosophical position.

This is the step most candidates skip.

And they pay for it later, usually in the viva, when the examiner asks why they chose their methods and the honest answer is "my supervisor told me to."

Your philosophy decides what counts as evidence in your study.

If you believe that people's experiences are socially constructed and that meaning matters more than measurement, you are working within an interpretivist position.

If you believe that reality can be measured objectively and that the goal is to find patterns across large groups, you are closer to a positivist position.

There are other positions too, pragmatism, critical realism, but the important thing is that you pick one and you can explain why.

In our smart home example, the candidate chose interpretivism. Why?

 Because the research question asks how smart home products support quality of life, and quality of life is experienced differently by every person.

It is not something you measure with a single number. It is something you explore through conversation.

That philosophical choice now shapes everything that follows.

DESIGN

Step 3: Choose your research design.

Qualitative, quantitative, or mixed.

And the choice is driven by your question and your philosophy, not by what feels comfortable or what your supervisor uses.

If your question asks "how" or "why" and your philosophy says meaning matters, you are probably looking at a qualitative design.

If your question asks "how much" or "what is the relationship between" and your philosophy says measurement matters, you are looking at quantitative.

If your question has two parts that need different kinds of evidence, mixed methods might be the right fit.

Our candidate chose sequential mixed methods:

• Phase 1 qualitative (interviews to explore the experience in depth), then
• Phase 2 quantitative (a survey to test what she found across a larger group). That design came from the question and the philosophy.

It was not picked because mixed methods sounds impressive. It was picked because the question needed both depth and breadth.

Step 4: Select your specific methods.

Now, and only now, do you pick your tools. Interviews, surveys, focus groups, observations, secondary data analysis.

The method has to collect the kind of evidence your design needs.

If your design needs lived experience, no survey will get you there.

If your design needs scale, no set of interviews will give you enough. The method serves the design.

The design serves the philosophy.

The philosophy serves the question.

That is the chain.

Our candidate picked semi-structured interviews for Phase 1 (sixty minutes each, conducted in participants' homes so she could see the smart home products in context);

and a survey instrument for Phase 2 (validated through two pilot rounds before the main data collection).

Each method matched what that phase of the design needed.

EXECUTION

Step 5: Design your sampling strategy.

"I will know when I reach saturation" is not an answer your examiner will accept.

We want a number, a reason for that number, and a clear description of who is in your sample and why.

Our candidate designed Phase 1 as purposive sampling: twenty older adults aged 65 and over, living independently, with varied living arrangements to capture different experiences.

Phase 2 used stratified random sampling with 300 participants to test the patterns from Phase 1 at scale.

Both numbers had a reason. Both samples had clear selection criteria.

Step 6: Plan your analysis approach.

Choose your analytical framework before you collect a single piece of data.

Examiners can always tell when the analysis was bolted on afterwards because the method and the analysis do not fit together properly.

Our candidate chose reflexive thematic analysis (following Braun and Clarke) for Phase 1, because it fits an interpretivist approach and works well with semi-structured interview data.

For Phase 2 she chose structural equation modelling, because it tests the relationships between variables at scale.

Both choices were made before data collection started, and both connected back to the design.

Why Order Matters More Than Quality

Here is something I have learned after examining over thirty methodology chapters:

A methodology that is average but built in the right order is easier to defend than one that is technically strong but built backwards.

When the chain holds from question to philosophy to design to methods to sampling to analysis, the examiner can follow your thinking even if they would have made different choices.

When the chain is broken, every choice looks arbitrary, and arbitrary choices lead to major corrections.

Most mentees come to me at step four.

They have picked their methods, sometimes already collected data, and now they are trying to retrofit a philosophy and a design onto choices they have already made.

We always have to go back to step one, and the methods change every time.

Key Takeaways

1. Your methodology is not your methods. It is the chain of reasoning that connects your question to your philosophy to your design to your tools to your sampling to your analysis.
2. The six steps must be done in order: question, philosophy, design, methods, sampling, analysis. Skipping ahead is how methodology chapters fail.
3. Every choice needs a reason, and that reason must connect to the step before it. If you cannot explain why, your examiner will ask.