7 comments

  • gavinray12 minutes ago
    <p><pre><code> &gt; The shift for me was realizing test generation shouldn’t be a one-off step. Tests need to live alongside the codebase so they stay in sync and have more context. </code></pre> Does the actual test code generated by the agent get persisted to project?<p>If not, you have kicked the proverbial can down the road.
  • avikaa48 minutes ago
    This solves a massive headache. The drift between externally generated tests and an active codebase is a brutal problem to maintain.<p>Using vision-based execution instead of brittle XPaths is a great baseline, but moving the test definitions to live directly alongside the repo context is definitely the real win here.<p>Did you find that generating the YAML from the codebase context entirely eliminated the &quot;stale test&quot; issue, or do developers still need to manually tweak the generated YAML when mobile UI layouts change drastically? Great project!
    • ashish00440 minutes ago
      Hi Avikaa, finalrun provides skills that you can integrate with any IDE of your choice. You can just ask the finalrun-generate-test skill to update all the test for your new feature.
  • sahilahuja1 hour ago
    Agentic testing. Kudos to your decision to open-source it!
  • arnold_laishram3 hours ago
    Looks pretty cool. How does your agent understand plain english?
    • ashish0043 hours ago
      We have built a QA agent that can understand your plain english intent and uses vision to reason and navigate the app to test your intent. You can check our benchmark here <a href="https:&#x2F;&#x2F;finalrun.app&#x2F;benchmark&#x2F;" rel="nofollow">https:&#x2F;&#x2F;finalrun.app&#x2F;benchmark&#x2F;</a> and how we architected our agent for the benchmark <a href="https:&#x2F;&#x2F;github.com&#x2F;final-run&#x2F;finalrun-android-world-benchmark" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;final-run&#x2F;finalrun-android-world-benchmar...</a>. Its all open source
  • rootally734 minutes ago
    [dead]
  • arbaaz3 hours ago
    [dead]