tests

Device Connect Integration Tests

Cross-package integration tests for the Device Connect monorepo. Validates that device-connect-edge, device-connect-server, and device-connect-agent-tools work together end-to-end.

Architecture

tests/
├── tests/                  # Test modules
│   ├── test_device_lifecycle.py       # Device connect/disconnect/heartbeat
│   ├── test_d2d_events.py             # Device-to-device events
│   ├── test_d2d_rpc.py                # Device-to-device RPC
│   ├── test_d2o_events.py             # Device-to-orchestrator events
│   ├── test_d2o_rpc.py                # Device-to-orchestrator RPC
│   ├── test_sensor_device.py          # Sensor device patterns
│   ├── test_multi_device_scenario.py  # Multi-device scenarios
│   ├── test_d2d_discovery.py          # D2D device discovery
│   ├── test_tools_discover.py         # Agent tools: device discovery
│   ├── test_tools_invoke.py           # Agent tools: function invocation
│   ├── test_strands_agent.py          # Strands agent integration (LLM)
│   ├── test_messaging_conformance.py  # Messaging backend conformance
│   └── test_zenoh_streaming.py        # Zenoh streaming patterns
├── fixtures/               # Shared pytest fixtures
│   ├── infrastructure.py   # Docker Compose lifecycle management
│   ├── devices.py          # Device factory for spawning test devices
│   ├── events.py           # NATS event capture utilities
│   ├── inject.py           # Event injection utilities
│   └── orchestrator.py     # Orchestrator fixtures (mock + real LLM)
├── conftest.py             # Root conftest with session-scoped fixtures
├── docker-compose-itest.yml # NATS + etcd + registry services
├── requirements.txt        # Test dependencies
└── pytest.ini              # Pytest configuration

Infrastructure

Tests run against Docker Compose services in dev mode (no TLS, no JWT):

Service	Image	Port
Zenoh router	eclipse/zenoh:latest	7447
NATS + JetStream	nats:2.10-alpine	4222
etcd	quay.io/coreos/etcd:v3.5.9	2379
Device Registry	Built from device-connect-server	8000

The infrastructure session-scoped fixture manages the lifecycle automatically.

Prerequisites

git clone https://github.com/arm/device-connect.git
cd device-connect

Setup

cd tests
python -m venv .venv && source .venv/bin/activate

# Install all packages in editable mode
pip install -e ../packages/device-connect-edge
pip install -e "../packages/device-connect-server[all]"
pip install -e "../packages/device-connect-agent-tools[strands]"
pip install -r requirements.txt

Running Tests

Start infrastructure

docker compose -f docker-compose-itest.yml up -d

Tier 1: Core integration tests (no LLM)

pytest tests/ -v -m "not llm" --timeout=120

Tier 2: LLM tests (requires API key)

export OPENAI_API_KEY="sk-..."
# or
export ANTHROPIC_API_KEY="sk-ant-..."

pytest tests/ -v -m "llm" --timeout=120

Messaging conformance tests

pytest tests/test_messaging_conformance.py -v -m conformance --timeout=60

Run everything

pytest tests/ -v --timeout=120

Tear down

docker compose -f docker-compose-itest.yml down -v --remove-orphans

Test Markers

Marker	Description
integration	Requires Docker infrastructure (auto-added)
llm	Requires a real LLM API key
slow	Takes > 30 seconds
conformance	Messaging backend conformance tests

CI/CD

Tests run automatically via GitHub Actions (.github/workflows/ci.yml):

• On push to main
• On pull request to main
• On schedule — weekdays at 6 AM UTC
• Manual — via workflow_dispatch

CI Jobs

1. unit-tests-sdk / unit-tests-server / unit-tests-agent-tools — parallel unit tests per package
2. lint — ruff check on all packages
3. integration-tests — Tier 1 (no LLM), runs after unit tests pass
4. llm-tests — Tier 2 (requires OPENAI_API_KEY secret), runs after Tier 1
5. conformance-tests — Messaging backend conformance, runs after Tier 1

Environment Variables

Variable	Default	Description
NATS_URL	nats://localhost:4222	NATS server URL
ETCD_URL	http://localhost:2379	etcd server URL
DEVICE_CONNECT_ALLOW_INSECURE	(unset)	Set to true for dev mode
ITEST_KEEP_INFRA	(unset)	Set to 1 to keep infra after run
OPENAI_API_KEY	(unset)	OpenAI API key for LLM tests
ANTHROPIC_API_KEY	(unset)	Anthropic API key for LLM tests