Gray Matter LogoGray Matter Workshop

Vision Options

KEY CONCEPT

Computer Vision - See the Field

Cameras let a robot detect game pieces, track targets, and figure out where it is on the field. AprilTags provide absolute field positioning, while object detection helps with game piece manipulation.

โ†ณ TAKEAWAY

Without vision, your robot only knows where odometry says it is. With it, the robot can see the field and correct itself.

Why Vision Matters in FRC

Absolute Positioning

AprilTags provide known field positions, enabling accurate robot localization and drift correction for odometry.

Game Piece Detection

Detect and track notes, cones, cubes, or other game pieces for autonomous pickup and scoring.

Target Tracking

Aim and shoot at targets dynamically, adjusting for robot and target movement in real-time.

๐Ÿ’ก Vision is Essential for Competitive Play

Modern FRC all but requires vision for accurate autonomous and teleop assists. Top teams run multiple cameras to keep more of the field in view.

FRC Vision System Options

1

Limelight

Dedicated vision hardware with integrated processing, LEDs, and a NetworkTables interface. Plug it in and it works.

โœ… Advantages

  • Zero code required for basic detection
  • Built-in LED ring for consistent lighting
  • Hardware-accelerated processing
  • Web interface for tuning pipelines
  • NetworkTables integration out-of-box
  • Proven reliability in competition

โš ๏ธ Limitations

  • Higher cost (~$400-500)
  • Proprietary hardware and software
  • Limited customization vs open source

๐ŸŽฏ Best For

Teams that want proven vision hardware with minimal setup and are willing to pay for the convenience.

2

PhotonVision

Open-source vision software that runs on coprocessors (Raspberry Pi, Orange Pi, etc.). The cheaper, do-it-yourself route.

โœ… Advantages

  • Free and open source
  • Works with any USB camera
  • Active development and community
  • Advanced AprilTag support
  • Multi-tag pose estimation
  • Lower total cost (~$100-150)

โš ๏ธ Limitations

  • Requires coprocessor setup
  • More configuration complexity
  • Camera and lighting selection matters
  • Performance depends on hardware chosen

๐ŸŽฏ Best For

Teams that want cheap, flexible vision and don't mind the extra setup. Great for AprilTag localization.

Hardware Setup

๐Ÿ”Œ Power & Connectivity

  • Power: Connect Limelight to the PDH/PDP (12V). Do not use the VRM unless necessary.
  • Ethernet: Connect directly to the radio or use a network switch if you have multiple devices.
  • Mounting:Mount cameras where they can see the scoring tags while you're scoring, and not at the same height as the tags. The camera should view a tag at an angle (left or right, and up or down).

๐Ÿท๏ธ AprilTag Configuration

Ensure your Limelight is up to date and configured for the current game's AprilTag field map.

  • Update Limelight OS to the latest version via USB flash drive.
  • Download the latest AprilTag Field Map from the Limelight Downloads page.
  • Upload the map via the Limelight web interface (Hardware Manager 2.0).

Vision System Comparison

FeatureLimelightPhotonVision
Cost$400-500$100-150
Setup ComplexityVery EasyModerate
HardwareIntegrated unitCoprocessor + Camera
AprilTag SupportYesYes
Custom PipelinesWeb interfaceWeb interface + Code
Community SupportLarge, establishedGrowing, active
Best Use CasePlug-and-play reliabilityCost-effective flexibility

AprilTag Localization

AprilTags are fiducial markers placed at known locations on the FRC field. Cameras can detect these tags and calculate the robot's absolute field position.

How AprilTags Work

  • Tags have unique IDs corresponding to field positions
  • Camera detects tag and calculates relative pose
  • Robot position computed from known tag location
  • Multiple tags improve accuracy through fusion

Benefits for FRC

  • Corrects odometry drift automatically
  • Enables accurate autonomous navigation
  • Works regardless of starting position
  • Provides absolute field coordinates

Multi-Camera Setup

Many top teams use multiple cameras: one facing forward for game pieces, and others positioned to always see AprilTags for continuous localization.

Recommended Approach for This Workshop

๐Ÿ“ท Using Limelight

For this workshop, we'll use Limelight for its simplicity and reliability. The focus is on integrating vision data into your robot code, not configuring vision hardware.

What You'll Learn

  • Reading vision data from NetworkTables
  • Integrating AprilTag poses into odometry
  • Using vision for target tracking
  • Commanding turrets/shooters based on vision

Additional Resources

CHECKPOINT ยท 5 ITEMS

What's Next?

Up Next: Implementing Vision

You'll integrate Limelight into your swerve drivetrain for AprilTag-based pose estimation and odometry correction.