A consequence of the growing number empirical studies in software engineering is need to adopt systematic approaches assessing and aggregating research outcomes order provide a balanced objective summary evidence for particular topic. The paper reports experiences with applying one such approach, practice literature review, published relevant topics within domain. review process summarised, reviews being undertaken by authors others are described some lessons about applicability this...

Empirical software engineering research needs guidelines to improve the and reporting processes. We propose a preliminary set of aimed at stimulating discussion among researchers. They are based on review developed for medical researchers our own experience in doing reviewing research. The intended assist researchers, reviewers, meta-analysts designing, conducting, evaluating empirical studies. Editorial boards journals may wish use recommendations as basis developing reviewers framing...

Objective: Our objective is to describe how softwareengineering might benefit from an evidence-basedapproach and identify the potential difficultiesassociated with approach.Method: We compared organisation technicalinfrastructure supporting evidence-based medicine (EBM)with situation in software engineering. consideredthe impact that factors peculiar engineering(i.e. skill factor lifecycle factor) would haveon our ability practice (EBSE).Results: EBSE promises a number of benefits...

Case studies help industry evaluate the benefits of methods and tools provide a cost-effective way to ensure that process changes desired results. However, unlike formal experiments surveys, case do not have well-understood theoretical basis. This article provides guidelines for organizing analyzing so they produce meaningful results.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

In this paper we propose a framework for validating software measurement. We start by defining measurement structure model that identifies the elementary component of measures and process, then consider five other models involved in measurement: unit definition models, instrumentation attribute relationship protocols entity population models. number from viewpoint our validation identify shortcomings; particular problems with construction function points. also compare view ideas presented...

If you are a software developer, manager, or maintainer, quality is often on your mind. But what do really mean by quality? Is definition adequate? the produce better worse than would like it to be? We put trial, examining both and evaluation of our products processes.

The mean magnitude of relative error, MMRE, is probably the most widely used evaluation criterion for assessing performance competing software prediction models. One purpose MMRE to assist us select best model. In this paper, we have performed a simulation study demonstrating that does not always Our findings cast some doubt on conclusions any models use as basis model comparison. We therefore recommend using evaluate and compare At present, do universal replacement MMRE. Meanwhile,...

Software managers and practitioners often must make decisions about what technologies to employ on their projects. They might be aware of problems with current development practices (for example, production bottlenecks or numerous defect reports from customers) want resolve them. Or, they have read a new technology take advantage its promised benefits. However, can difficulty making informed whether adopt because there's little objective evidence confirm suitability, limits, qualities,...

The paper aims to provide the software estimation research community with a better understanding of meaning of, and relationship between, two statistics that are often used assess accuracy predictive models: mean magnitude relative error, MMRE, number predictions within 25% actuals, pred(25). It is demonstrated MMRE pred(25) are, respectively, measures spread kurtosis variable z where z=estimate/actual. Thus, considered be measure accuracy, such as properties distribution z. suggested...

Our objective is to describe how software engineering might benefit from an evidence-based approach and identify the potential difficulties associated with approach. We compared organisation technical infrastructure supporting medicine (EBM) situation in engineering. considered impact that factors peculiar (i.e. skill factor lifecycle factor) would have on our ability practice (EBSE). EBSE promises a number of benefits by encouraging integration research results view needs many different...

<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Context</i> : Several tertiary studies have criticized the reporting of software engineering secondary studies. xmlns:xlink="http://www.w3.org/1999/xlink">Objective</i> Our objective is to identify guidelines for (SE) which would address problems observed in systematic reviews (SRs). xmlns:xlink="http://www.w3.org/1999/xlink">Method</i> We review criticisms SE and major areas concern. assess...

article Share on Principles of survey research: part 1: turning lemons into lemonade Authors: Shari Lawrence Pfleeger Systems/Software, Inc., Washington, DC DCView Profile , Barbara A. Kitchenham Keele University, Staffordshire, UK UKView Authors Info & Claims ACM SIGSOFT Software Engineering NotesVolume 26Issue 6November 2001 pp 16–18https://doi.org/10.1145/505532.505535Online:01 November 2001Publication History 182citation3,810DownloadsMetricsTotal Citations182Total Downloads3,810Last 12...

This article is the fifth installment of our series articles on survey research. In it, we discuss what mean by a population and sample implications each for We provide examples correct incorrect sampling techniques used in software engineering surveys.

The staff resources or effort required for a software project are notoriously difficult to estimate in advance. To date most work has focused upon algorithmic cost models such as COCOMO and Function Points. These can suffer from the disadvantage of need calibrate model each individual measurement environment coupled with very variable accuracy levels even after calibration. An alternative approach is use analogy estimation. We demonstrate that this method considerable promise we show it out...