Update inference extension conformance tests

[salonichf5]

Proposed changes

Write a clear and concise description that helps reviewers understand the purpose and impact of your changes. Use the
following format:

Problem: Users want to enable conformance tests to ensure correct checks are in place

Solution: Enables conformance test

Testing: Manually being tested still.

Please focus on (optional): If you any specific areas where you would like reviewers to focus their attention or provide
specific feedback, add them here.

Closes #3842

Checklist

Before creating a PR, run through this checklist and mark each as complete.

• I have read the CONTRIBUTING doc
• I have added tests that prove my fix is effective or that my feature works
• I have checked that all unit tests pass after adding my changes
• I have updated necessary documentation
• I have rebased my branch onto main
• I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes

If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

Enable conformance tests for Inference Extension

[bjee19]

gonna leave my approval here awaiting conformance tests passing

[ciarams87]

Thank you so much for your perseverance in getting this over the line 🚀 🔥