Skip to content

CodeAssist failing on correct solutions #28

@0xZackHQ

Description

@0xZackHQ

Issue Type

✔ Bug Report

  • Feature Request
  • Question / Help Needed
  • Other

Description

CodeAssist is incorrectly marking fully correct solutions as failed, even when the logic and output match the expected results. This issue appears consistently after around case #42–43, regardless of the problem being solved. Because of this, problems do not get marked as solved, and progress cannot be completed or submitted.

This has happened to me across multiple LeetCode-style problems over the past two days, and it prevents me from continuing practice.

The screenshot attached (below) demonstrates the issue for one example.

Steps to Reproduce (for bugs)

  1. Open Problem 2427: Number of Common Factors on CodeAssist.
  2. Submit a correct solution (example below).
  3. CodeAssist passes around 42 cases and then incorrectly fails at case #43, despite output being correct.
  4. The problem remains unsolved and cannot be completed.
Image

Example code used (fully correct, matches LeetCode editorial logic):

from math import gcd

class Solution:
    def commonFactors(self, a: int, b: int) -> int:
        g = gcd(a, b)
        return sum(g % i == 0 for i in range(1, g + 1))

Expected Behavior

Correct solutions should be validated properly, and the problem should be marked as solved once the logic and outputs match expected results.

Actual Behavior (for bugs)

  • CodeAssist fails correct submissions around test case #42–43, even when the output is correct.
  • The problem never gets marked as “Solved.”
  • This occurs across multiple problems, not only one.

Environment

  • Version/Commit SHA: 906a34e
  • OS & version: Ubuntu 24.04.3 LTS
  • Installation method: Docker
  • Python Version: 3.12.3
  • Docker Version: 29.1.1, build 0aedba5
  • Browser: Chrome 142.0.7444.176

Configuration & Logs

No additional logs, the issue occurs at the result panel stage.
I included a screenshot showing the incorrect failure for test #43.

Additional Context

  • This issue prevents completing problems and makes practice progress impossible.
  • I am not using debug prints or extra output.
  • The problem persists across ~10–20 different problems tested recently.

Discord Username (Optional)

0xzackhq

Proposed Solution (for feature requests)

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions