AI and software development quality

Jim Rowan, Brenna Sniderman, Beena Ammanath, David Jarvis, and Costi Perricos, “The State of Generative AI in the Enterprise,” Deloitte Global, Aug. 21, 2024.

View in Article

Laura Shact, Brad Kreit, Gregory Vert, Jonathan Holdowsky, Natasha Buckley, “Four futures of generative AI in the enterprise: Scenario planning for strategic resilience and adaptability,” Deloitte Insights. 

View in Article

Isabelle Bousquette, “Goldman Sachs deploys its first generative AI tool across the firm,” The Wall Street Journal, June 27, 2024. 

View in Article

Deloitte interviews conducted for this research.

View in Article

Ibid.

View in Article

George Lawton, “AI development tools make software development easier,” TechTarget, Aug. 30, 2019.

View in Article

Yohannes Yebabe Tesfay, “Quality in the context of engineering,” Developing Structured Procedural and Methodological Engineering Designs: Applied Industrial Engineering Tools (Springer, Cham, 2021), pp. 3–57.

View in Article

Parastoo Mohagheghi, Vegard Dehlen, and Tor Neple, “Definitions and approaches to model quality in model-based software development–A review of literature,” Information and Software Technology 51, no. 12 (2009): pp.1646–1669.

View in Article

Faruk Muratovic, Duncan Stewart, and Prashant Raman, “Tech companies lead the way on generative AI: Does code deserve the credit?” Deloitte Insights, Aug. 2, 2024.

View in Article

Deloitte interview with Randeep Khaund, July 19, 2024. 

View in Article

Deloitte interview with Siva Muthu, July 23, 2024. 

View in Article

Deloitte interview with Faruk, July 11, 2024.

View in Article

Deloitte interviews conducted in July 2024.

View in Article

Deloitte interview with Ryan Lockard, July 2024.

View in Article

Anil R. Doshi and Oliver P. Hauser, “Generative AI enhances individual creativity but reduces the collective diversity of novel content,” Science Advances 10, no. 28 (2024): eadn5290.

View in Article

Hang Zou, Qiyang Zhao, Lina Bariah, Mehdi Bennis, and Merouane Debbah, “Wireless multi-agent generative ai: From connected intelligence to collective intelligence,” arXiv preprint (2023).

View in Article

Jeremy Harper, “AutoGenesisAgent: Self-generating multi-agent systems for complex tasks,” arXiv preprint arXiv:2404.17017 (2024).

View in Article

Deloitte interview with Kenny Brown, July 29, 2024.

View in Article

Yasumasa Kano, Katsuhito Sudoh, and Satoshi Nakamura, “Average token delay: A latency metric for simultaneous translation,” Nara Institute of Science and Technology,” November 2022.

View in Article

Deloitte interview with Siva Muthu, July 23, 2024.

View in Article

Kevin Murphy, “Machine learning: A probabilistic perspective,” MIT Press, August 2012.

View in Article

Deloitte interview with Sumeet Dey, July 18, 2024. 

View in Article

Deloitte Interviews conducted for The State of Generative AI in the Enterprise report, 2024.

View in Article

Ibid.

View in Article

Deloitte interview with Tim Juravich, July 15, 2024.

View in Article

Deloitte Interviews conducted for The State of Generative AI in the Enterprise report, 2024.

View in Article

Deloitte interview with Kenny Brown, July 29, 2024.

View in Article

Ibid.

View in Article

AI skills challenge, “Monitor quality and token usage of deployed prompt flow applications,” Microsoft. 

View in Article

Deloitte interview with Kenny Brown, July 29, 2024.

View in Article

Ibid.

View in Article

Thilo Hagendorff, “Deception abilities emerged in large language models,” PNAS, June 4, 2024.

View in Article

Deloitte interview with Dean Sauer, July 19, 2024.

View in Article

Deborshi Dutt, Beena Ammanath, Costi Perricos, and Brenna Sniderman, “The State of Generative AI in the Enterprise,” Deloitte Global, January, 2024.

View in Article

Angus Yang, Zehan Li, and Jie Li, “Advancing GenAI assisted programming – A comparative study on prompt efficiency and code quality between GPT-4 and GLM-4,” February 2024.

View in Article

Zhijie Liu, Yutian Tang, Xiapu Luo, Yuming Zhou, and Liang Feng Zhang, “No need to lift a finger anymore? Assessing the quality of code generation by ChatGPT,” IEEE 50, no. 6 (2024).

View in Article

Deloitte interview with Dean Sauer, July 19, 2024.

View in Article

Deloitte interview with Kenny Brown, July 29, 2024.

View in Article

Liam Proven, “Drowning in code: The ever-growing problem of ever-growing codebases,” The Register, Feb. 12, 2024.

View in Article

Thomas H. Davenport and Nitin Mittal, “How generative AI is changing creative work,” Harvard Business Review, Nov. 14, 2022.

View in Article

Kaustubh Bagalkote, “Amazon CEO Andy Jassy says company’s AI assistant has saved $260M and 4.5K developer-years of work: ‘It’s been a game changer for us’,” Yahoo Finance, Aug. 24, 2024.

View in Article

Deloitte interview with Tim Juravich, July 15, 2024.

View in Article

Rachel Gordon, “Reasoning skills of large language models are often overestimated,” MIT Computer Science and Artificial Intelligence Laboratory, July 11, 2024.

View in Article

Jagjeet Gill and Ram Ravi, “Horizon architecture: Business strategy activation,” Deloitte US, 2024.

View in Article

Stefan Aulbach, Bjoern Langmack, Matthias Lachmann, Martin Eberle, and Yihong Zeng, “AI-powered application rewrite: Revolutionizing legacy code transformation,” Deloitte US, 2024.

View in Article

Deloitte interview with Randeep Khaund, July 19, 2024.

View in Article

Deloitte interview with Ed Bowen, July 18, 2024.

View in Article

Deloitte interview with Siva Muthu, July 23, 2024.

View in Article

Deloitte interview with Ryan Lockard, July 18, 2024.

View in Article

Deloitte interview with Jay McDonald, July 16, 2024.

View in Article

Deloitte interview with Siva Muthu, July 23, 2024.

View in Article

Deloitte interview with Jay McDonald, July 16, 2024.

View in Article

Deloitte interview with Siva Muthu, July 23, 2024.

View in Article

Deloitte interview with Tim Juravich, July 15, 2024.

View in Article

Deloitte interview with Jay McDonald, July 16, 2024.

View in Article

Rowan, Sniderman, Ammanath, Jarvis, and Perricos, “The State of Generative AI in the Enterprise.”

View in Article

Ibid.

View in Article

Ibid.

View in Article

Deloitte interview with Govina Parashar, Aug. 9, 2024.

View in Article

Deloitte interview with David Kuder, July 17, 2024.

View in Article

Deloitte interview with Govina Parashar, Aug. 9, 2024.

View in Article

Ibid.

View in Article

Srikanth Jandhyala, Jinwoo Kim, and Arpita Bhattacharyya, Finnegan, “IP issues with AI code generators,” Bloomberg Law, January 2023.

View in Article

Deloitte interview with Jay McDonald, July 16, 2024.

View in Article

Jandhyala, Kim, and Bhattacharyya, Finnegan, “IP Issues with AI code generators.

View in Article

Ibid.

View in Article

Deloitte interview with Sumeet Dey, July 18, 2024.

View in Article

Darren Orf, “A new AI discovery sure looks like the dawn of true machine reasoning,” Popular Mechanics, May 17, 2024. 

View in Article

Justin D. Weisz, Michael Muller, Steven I. Ross, Fernando Martinez, Stephanie Houde, Mayank Agarwal, Kartik Talamadupula, and John T. Richards, “Better together? An evaluation of ai-supported code translation,” In Proceedings of the 27th International Conference on Intelligent User Interfaces, 2022, pp. 369–391.

View in Article

Aggregate qualitative analysis of interviews conducted for this research, Aug. 9, 2024.

View in Article