https://javapro-en.svenruppert.com/tags/comparision/Recent content in Comparision on JAVAPRO InternationalHugoen-USThu, 07 Nov 2024 10:05:34 +0000https://javapro-en.svenruppert.com/1-billion-record-challenge-ai-style/Thu, 07 Nov 2024 10:05:34 +0000https://javapro-en.svenruppert.com/1-billion-record-challenge-ai-style/<p><strong>Previously …</strong></p> <p>I recently <a href="https://javapro.io/2024/10/17/are-ai-coding-tools-worth-it-part-1/">wrote</a> about my experiences with getting AI coding tools to find bugs and write tests.  I picked five different tools. The selection criteria were simple - free or trial with no credit card needed.  I chose three tools designed to help developers and two general-purpose LLMs.  </p> <p>I gave them a 1000-line Java program and asked them to do three things.</p> <ul> <li>Add Javadoc to explain what the code did</li> <li>Analyse the code for bugs and design weaknesses</li> <li>Create Junit testcases that would provide reasonable code coverage.</li> </ul> <p>The results were disappointing but, in hindsight, predictable.  Overall, the tools were better at creating documentation than finding bugs and, apart from one, were pretty poor at writing test cases.  </p>