Assessment

HEC Montréal - INTE60006A.H2021

Thierry Warin https://warin.ca/cv/thierry.html (HEC Montréal & Cirano (Montréal))https://www.hec.ca
01-13-2021

Evaluations

Goals

School’s regulations

Pedagogical guidelines for learning assessments

Exams: check them out before the big day (when not online! 1. The validity of your student card. To know more about it… 2. 2. The exam schedule and room (in HEC online) 3. The documentation authorized for the exam (on my ZoneCours site) 4. The conformity of my calculator.

Research Project

Description

This research project is designed to make you get ready for your supervised project or your research project during these years at the Msc. And you do in a team of 3 people. So, it is a good training before your solitary venture into your own supervised or research project.

Of course, since we look everything with an evidence-based perspective, ie based on data and well-analyzed data (= well modeled).

The idea of doing research is profoundly a humbling exercise. It is about the researcher recognizing that s.he knows very little. As a researcher, we need to look at the previous contributions. We do not start a research project based on an intuition per se. We start by looking at the the results other researchers have produced. And we wonder what could be the gaps and what could be our contribution as someone who knows data science. What new data can I bring to serve as a better proxy? What new Analysis can I build to refine the results. Footnote: refining means very often adding complexity to the analysis.

Once we know how we can contribute to the literature, we formulate our research question and methodological design.

At this stage, we take the previous results from the literature review as the relevant hypotheses for our own modeling. These hypotheses will be challenged by our data and Analysis, and we will produce new results. These new results will thus serve as hypotheses for other researchers.

Research is thus a continuum of trials and errors, validation and invalidation of previous theories. According to Karl Popper, this is the essence of science.

I expect you to follow this process. I am not expecting you to produce a Nobel Prize paper, let the pressure down. If you produce a Nobel Prize paper, please do it, do not refrain yourself though.

A research paper is organized as follows:

  1. Introduction: research question and context
  2. Literature review
  3. Exploratory Data Analysis
  4. Analysis
  5. Results and implications (policies, strategies, etc.)
  6. Conclusion
  7. References

This research project has to be done with the tools we provide you (Tableau, Zotero). Otherwise, it is not fun.

Where can I find research questions?

The easiest and safest way is to look at published papers and try to replicate them with an updated dataset or a new research question. Those here are just examples:

Here: International Economics Papers

or here: Peterson Institute

Agenda

To help you deconstruct your research project into a lean project management, here is a schedule of what you have to send me at the specific dates:

  1. Research question an research context: session 4
  2. First draft of outline of your literature review: session 6
  3. EDA: session 8
  4. Analysis: session 10
  5. Final paper: Last session

The research paper length should be a maximum of 5,000 words including the references.

What you are learning in the course

You are learning how to use Tableau for quantitative-based research. When it comes to the “research” side of the phrase, we need to develop some skills into study design, i.e. what is a model and how to create one.

In being a modeler, you need to particularly pay attention to your research question (which means the literature review as well) and how you can test it.

Hypothesis testing

A hypothesis is a tentative statement that proposes a possible explanation to some phenomenon or event. A useful hypothesis is a testable statement, which may include a prediction. This is why in statistiics we form H0 and H1. The most important between both is H0, as H1 is phrased as “we cannot reject H0”. It is not only a philosophical position, it means we cannot prove H1, just think about it for a minute. You will see how big it is ;-).

A hypothesis should not be confused with a theory. Theories are general explanations based on a large amount of data. For example, the theory of multinational corporations’ internationalization is comprehensive and is based on a wide range of observations. However, there are many things about this theory that are not fully understood such as gaps in some propositions. Many hypotheses have been proposed and tested.

The key word is testable. That is, you will perform a test of how two variables might be related. This is when you are doing a real experiment. You are testing variables. Usually, a hypothesis is based on some previous observation such as noticing potential correlations. Are these two events connected? How?

Evaluation criteria

I use the same evaluation grid as for supervised projects and theses.

See here: https://formulaires.hec.ca/repository/registrariat/files/private/guide_evaluation_ps_fr.pdf

Excellent Very good Good Fair Insufficient
1. Demonstration of autonomy
The student respected the established schedule
The student has shown initiative in implementing the means necessary for the completion of the project
2. Formulation of the problem
Clarity of the formulation of the studied problem
Links established with the knowledge acquired in the field of specialization
3. Review of the literature allowing to identify and solve the studied problem (for a work of a scope of 9 credits)
Relevance of references
Judicious use of literature
4. Choice of methods for the resolution of the problem
Relevance of the methods chosen
Justification of the choices
5. Application of methods
Rigor in the application of methods
6. Analysis of results and conclusion
Correctness of analysis and interpretation
Depth of analysis and quality of argument for a 9-credit assignment
Discussion of limitations and avenues for improvement
7. Quality of communication in writing a report
Fluency in the language associated with the area of specialization
Clarity, structure, and level of conciseness in writing the report
Compliance with the rules set out in the guide for writing an academic paper
Final score Excellent (A +, A) Very good (A-, B +) Good (B, B-) Fair (C +, c) Insufficient (E)
Qualitative comments on the supervised project

TL;DR

Competitions to consider

Your research paper should definitely be considered for student competitions.