Enhance pipeline debugging

[jenniferjiangkells]

Description

The pipeline architecture lacks robust debugging capabilities and flexibility in accessing intermediate components, making troubleshooting and customization difficult.

Tasks

• Create a standardized way to access document objects and their properties at each pipeline stage
• Improve access to intermediate components and transformation artifacts for inspection
• Develop a more flexible configuration system for connectors that can be easily modified in pipelines