Experimental Software Engineering

Experimental Software Engineering

An experiment is an orderly procedure carried out with the goal of verifying, refuting, or establishing the validity of a hypothesis. Controlled experiments provide insight into cause-and-effect by demonstrating what outcome occurs when a particular factor is manipulated. Controlled experiments vary greatly in their goal and scale, but always rely on repeatable procedure and logical analysis of the results. There also exist natural experimental studies.

Experiment Types

Experiments might be categorized according to a number of dimensions, depending upon professional norms and standards in different fields of study.

Controlled experiments

A controlled experiment often compares the results obtained from experimental samples against control samples, which are practically identical to the experimental sample except for the one aspect whose effect is being tested.

Natural Experiment

Natural experiments rely solely on observations of the variables of the system under study, rather than manipulation of just one or a few variables as occurs in controlled experiments. To the degree possible, they attempt to collect data for the system in such a way that contribution from all variables can be determined, and where the effects of variation in certain variables remain approximately constant so that the effects of other variables can be discerned.


A quasi-experiment is an empirical study used to estimate the causal impact of an intervention on its target population. Quasi-experimental research shares similarities with the traditional experimental design or randomized controlled trial, but they specifically lack the element of random assignment to treatment or control. Instead, quasi-experimental designs typically allow the researcher to control the assignment to the treatment condition, but using some criterion other than random assignment (e.g., an eligibility cutoff mark).[1] In some cases, the researcher may have control over assignment to treatment condition.

Field Experiments

Field experiments are so named in order to draw a contrast with laboratory experiments, which enforce scientific control by testing a hypothesis in the artificial and highly controlled setting of a laboratory. Often used in the social sciences, and especially in economic analyses of education and health interventions, field experiments have the advantage that outcomes are observed in a natural setting rather than in a contrived laboratory environment. 



Minimize Lectures-Seminars-Training

Provision of training services (lectures, seminars and training courses) on a range of software engineering technologies. Please see the details.