Programmer eXperience: A Systematic Literature Review (2019). IEEE Access, 7, 71079-71094.

Jenny Morales (Autonomous University of Chile), Cristian Rusu (Pontifical Catholic University of Chile), Federico Botella (Miguel Hernández University of Elche) and Daniela Quiñones (Pontifical Catholic University of Chile).

Abstract. Programmers use various software development artifacts in their work, such as programming environments, design documents, and programming codes. These software artifacts can be studied and improved based on usability and User eXperience (UX) factors. In this paper, we consider programmers to be a specific case of users and analyze different elements that influence their experience in this specific context. We conducted a systematic literature review of papers published over the last ten years related to 1) the definition of the Programmer eXperience (PX); 2) the PX, UX, and usability factors regarding the programming environments, design documents, and programming codes; and 3) sets of heuristics to evaluate the software development artifacts mentioned before. We analyzed 73 articles, and the results obtained show that: 1) the important elements that influence the PX are the motivation of programmers and the choice of tools they use in their work, such as programming environments; 2) most of the identified studies (59%) aimed to evaluate the influence of the PX, UX, and usability on programming environments; 3) the majority of the studies (70%) used methods such as usability tests and/or heuristic evaluation methods; and 4) four sets of heuristics are used to evaluate software development artifacts in relation to programming environments, programming languages, and application programming interfaces. The results suggest that further research in this area is necessary to better understand and evaluate the concept of the PX.

Keywords. Heuristic evaluation; Programmer eXperience; Systematic literature review; User eXperience; Usability

Performance evaluation through DEA benchmarking adjusted to goals (2019). Omega, 87, 150-157.

José L. Ruiz (Miguel Hernández University of Elche) and Inmaculada Sirvent(Miguel Hernández University of Elche).

Abstract. Data Envelopment Analysis (DEA) is extended to the evaluation of performance of organizations within the framework of the implementation of plans for improvements that set management goals. Managers usually set goals without having any evidence that they will be achievable at the moment of conduct- ing performance evaluation or, on the contrary, they may set little too unambitious goals. Using DEA for the benchmarking ensures an evaluation in terms of targets that both are attainable and represent best practices. In addition, the approach we propose adjusts the DEA benchmarking to the goals in order to consider the policy of improvements that was pursued with the setting of such goals. From the method- ological point of view, the models that minimize the distance to the DEA strong efficient frontier are extended to incorporate goal information. Specifically, the models developed seek DEA targets that are as close as possible to both actual performances and management goals. To illustrate, we examine an example that is concerned with the evaluation of performance of public Spanish universities.

Keywords. Performance evaluation; Benchmarking; Goals; DEA; Target setting