Software quality is strongly correlated with the quantity and severity of bugs. While there are a variety of tools, techniques, and practices to aid production of robust and resilient code, low quality software is draining trillions of dollars from organizations annually. Meanwhile, debugging and fixing coding errors consumes upwards of half of developer labor. To say this situation is untenable is an understatement. Fortunately, automated software repair offers a possible solution. The literature around automated code fixing has been expanding with a variety of implementations ranging from genetic programming, code translation, and various machine learning algorithms. All report positive results, however there has not yet been a dedicated effort to measure to what extent the various implementations are generalizable. Accordingly, we sought to replicate a prominent study in the field in two parts. The first part consisted of replicating the training of the machine learning model using the source study materials. We found training to be impossible at first due to package dependencies and missing package files. However, we were able to replicate the self-repair evaluation. The results were identical to the source study. Later, using a Docker compose file obtained from the original authors, we were able to replicate BIFI model training and again match outcomes. Overall, based on the replication outcomes, we offer future leaning recommendations and ideas for future work.

More from our Archive

• DOI: 10.1093/femsre/fuad039 2023

  <i>Faecalibacterium</i>: a bacterial genus with promising human health applications

  Rebeca Martín, David Rios-Covian, Eugénie Huillet, Sandrine Auger, Sarah Khazaal, Luis G Bermúdez-Humarán, Harry Sokol, Jean-Marc Chatel, Philippe Langella

• DOI: 10.3390/foods12142704 2023

  Climate Change—A Global Threat Resulting in Increasing Mycotoxin Occurrence

  Jovana Kos, Mislav Anić, Bojana Radić, Manuela Zadravec, Elizabet Janić Hajnal, Jelka Pleadin

• DOI: 10.3390/cimb45070374 2023

  How Plants Tolerate Salt Stress

  Haiqi Fu, Yongqing Yang

• DOI: 10.1093/femsre/fuad041 2023

  Microbiologically influenced corrosion—more than just microorganisms

  J Knisz, R Eckert, L M Gieg, A Koerdt, J S Lee, E R Silva, T L Skovhus, B A An Stepec, S A Wade

• DOI: 10.3390/microorganisms11071765 2023

  Holistic Strategies to Control Salmonella Infantis: An Emerging Challenge in the European Broiler Sector

  Laura Montoro-Dasi, Laura Lorenzo-Rebenaque, Ana Marco-Fuertes, Santiago Vega, Clara Marin

• DOI: 10.1146/annurev-micro-032521-015858 2023

  <i>Candida auris</i> Genetics and Emergence

  Anuradha Chowdhary, Kusum Jain, Neeraj Chauhan

• DOI: 10.3390/foods12132529 2023

  Potential Beneficial Effects and Pharmacological Properties of Ergosterol, a Common Bioactive Compound in Edible Mushrooms

  Panthakarn Rangsinth, Rajasekharan Sharika, Nattaporn Pattarachotanant, Chatrawee Duangjan, Chamaiphron Wongwan, Chanin Sillapachaiyaporn, Sunita Nilkhet, Nichaporn Wongsirojkul, Anchalee Prasansuklab, Tewin Tencomnao, George Pak-Heng Leung, Siriporn Chuchawankul

• DOI: 10.1128/ecosalplus.esp-0002-2023 2023

  The EcoCyc Database (2023)

  Peter D. Karp, Suzanne Paley, Ron Caspi, Anamika Kothari, Markus Krummenacker, Peter E. Midford, Lisa R. Moore, Pallavi Subhraveti, Socorro Gama-Castro, Victor H. Tierrafria, Paloma Lara, Luis Muñiz-Rascado, César Bonavides-Martinez, Alberto Santos-Zavaleta, Amanda Mackie, Gwanggyu Sun, Travis A. Ahn-Horst, Heejo Choi, Markus W. Covert, Julio Collado-Vides, Ian Paulsen

• DOI: 10.1146/annurev-micro-032521-022006 2023

  Mobile Genetic Element Flexibility as an Underlying Principle to Bacterial Evolution

  Alexandra J. Weisberg, Jeff H. Chang

• DOI: 10.1093/femsre/fuad038 2023

  Drivers and consequences of bacteriophage host range

  Dominique Holtappels, Poliane Alfenas-Zerbini, Britt Koskella