Conversation
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…in attack history
…ype hints where its redundant
jbolor21
force-pushed
the
bjagdagdorj/frontend_converters
branch
from
446c643 to
69d038f
Compare
There was a problem hiding this comment.
Pull request overview
Adds a new “Converter Panel” to the PyRIT GUI so users can discover prompt converters, configure basic parameters, preview outputs, and apply one converter per modality per turn, with supporting backend endpoints and test coverage.
Changes:
- Backend: added a converter “catalog” API (types + supported IO + simple parameter schema) and enhanced preview to support non-text data types.
- Frontend: implemented the ConverterPanel UI (tabs by modality, parameter form, preview + “use converted value”) and integrated it into ChatWindow/ChatInputArea send flow.
- Tests: added/updated unit tests (backend + frontend) and introduced Playwright e2e coverage for converter workflows.
Reviewed changes
Copilot reviewed 22 out of 23 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/unit/backend/test_converter_service.py | Adds unit tests for the new converter catalog service method and updates preview-chain expectation. |
| tests/unit/backend/test_api_routes.py | Adds route-level test for /api/converters/catalog. |
| pyrit/backend/services/converter_service.py | Implements converter catalog generation (doc/params introspection), param coercion, and enhanced preview handling for media types. |
| pyrit/backend/services/attack_service.py | Ensures atomic_attack_identifier stays consistent when per-message converters update the attack identifier. |
| pyrit/backend/routes/converters.py | Adds a new GET /converters/catalog endpoint. |
| pyrit/backend/models/converters.py | Introduces DTOs for catalog entries and parameter schemas. |
| frontend/src/types/index.ts | Adds TS types for converter catalog and converter instances. |
| frontend/src/services/api.ts | Adds convertersApi client functions (catalog/create/preview/etc.). |
| frontend/src/components/Config/TargetConfig.test.tsx | Adds dialog cancel/close test coverage. |
| frontend/src/components/Config/CreateTargetDialog.test.tsx | Makes target creation test input method consistent. |
| frontend/src/components/Chat/converterTypes.ts | Adds shared mapping/types for piece-type ↔ data-type and conversion payloads. |
| frontend/src/components/Chat/ConverterPanel.tsx | New converter panel UI: selection, param editing, preview, auto-preview behavior, and “use converted value”. |
| frontend/src/components/Chat/ConverterPanel.test.tsx | Unit tests for converter panel UI behaviors (selection, params, preview, resizing, etc.). |
| frontend/src/components/Chat/ConverterPanel.styles.ts | Styles for the converter panel per repo convention. |
| frontend/src/components/Chat/ChatWindow.tsx | Integrates converter panel state + applies conversions into outgoing message requests. |
| frontend/src/components/Chat/ChatWindow.test.tsx | Adds integration tests covering converter panel toggling and preview flow in chat. |
| frontend/src/components/Chat/ChatInputArea.tsx | Adds converter toggle button, “converted” UI rows, and attachment→base64 propagation to converter panel. |
| frontend/src/components/Chat/ChatInputArea.test.tsx | Expands unit tests for converter toggle, converted UI, and attachment conversion indicators. |
| frontend/src/components/Chat/ChatInputArea.styles.ts | Layout updates for converted/original display and attachment rows. |
| frontend/package.json | Adds react-async-hook and bumps frontend version. |
| frontend/package-lock.json | Lockfile updates for new dependency/version bump. |
| frontend/e2e/converters.spec.ts | New Playwright e2e suite covering converter panel flows. |
| frontend/e2e/chat.spec.ts | Improves mocked message GET handling and skips a flaky/overbroad video role query test. |
Files not reviewed (1)
- frontend/package-lock.json: Language not supported
| <div key={param.name} className={styles.paramBlock}> | ||
| <span className={styles.paramLabel}> | ||
| <Text size={200} weight="semibold">{param.name}{param.required ? ' *' : ''}</Text> | ||
| {param.description && ( | ||
| <Tooltip content={param.description} relationship="description"> | ||
| <span className={styles.paramInfo}><InfoRegular fontSize={12} /></span> | ||
| </Tooltip> | ||
| )} | ||
| </span> |
There was a problem hiding this comment.
is this basically the same as InfoLabel ? https://storybooks.fluentui.dev/react/?path=/docs/components-infolabel--docs or what's the difference ?
There was a problem hiding this comment.
Yeah its similar but just a tooltip + icon pattern which "is meant to have short text and no interaction. If the content is longer and/or has interaction, then it must be an InfoButton." - the infobutton looks like you physically press the button if i'm looking correctly? this is the hover over tooltip if that makes sense!
| @@ -0,0 +1,107 @@ | |||
| import { Button, MessageBar, MessageBarBody, Spinner, Text } from '@fluentui/react-components' | |||
There was a problem hiding this comment.
do you have tests for these new classes somewhere ?
| input.onchange = () => { | ||
| const file = input.files?.[0] | ||
| if (file) { | ||
| setParamValues((prev) => ({ ...prev, [paramName]: file.name })) |
There was a problem hiding this comment.
does this work with the file path ?
| def _is_llm_based(converter_class: type) -> bool: | ||
| """Return True if the converter requires an LLM target parameter.""" | ||
| try: | ||
| sig = inspect.signature(converter_class.__init__) # type: ignore[misc] | ||
| except (ValueError, TypeError): | ||
| return False | ||
| return any("target" in name.lower() for name in sig.parameters if name != "self") |
There was a problem hiding this comment.
`from pyrit.prompt_target import PromptChatTarget
def _is_llm_based(converter_class: type) -> bool:
try:
sig = inspect.signature(converter_class.init)
except (ValueError, TypeError):
return False
for p in sig.parameters.values():
if p.name == "self":
continue
if isinstance(p.annotation, type) and issubclass(p.annotation, PromptChatTarget):
return True
return False`
bc this won't work for diacritic converter which has target_chars
| mime_guess = { | ||
| "image_path": ".png", | ||
| "audio_path": ".wav", | ||
| "video_path": ".mp4", | ||
| "binary_path": ".bin", | ||
| } |
There was a problem hiding this comment.
duplicated on 367 so hoist up to a constant
| elif annotation is bool: | ||
| coerced[name] = value.lower() in ("true", "1", "yes") | ||
| except (ValueError, TypeError): | ||
| pass |
There was a problem hiding this comment.
why do we pass here ?
Description
Adding converter panels to the GUI interface! This PR only lets you run ONE converter per turn per type of media (ie you can do an image + text conversion in same turn but not two text conversions in one turn)
Tests and Documentation
Images:
(new button is shown):
(new panel)
(panel dropdown)
(once you've selected converter)
(tabs for different modalities of converters - you can have 1 per mode per turn)
