Repository navigation
Conversation
Allow float8_e4m3fn or float8_e5m2 with float4_e2m1fn operands using UE8M0 scales and a scaling block size of 32, matching mxf8f6f4 constraints. Refs NVIDIA#118. Signed-off-by: SycamoreQ <kaushik.80405@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds cutile-python front-end support for mixed f8/f4 operands in
ct.mma_scaled, matching themxf8f6f4constraints:float8_e4m3fnorfloat8_e5m2withfloat4_e2m1fnin either operand order.float8_e8m0fnuscales and scaling block sizeB=32on both sides.The IR validation now receives pair-specific allowed block sizes from the datatype resolver, preventing mixed operands from incorrectly using the f4-only
B=16path.Backend dependency
End-to-end execution still requires a tileiras version with
mxf8f6f4support. The current tileiras rejects the operation, so the integration test is strict-xfailed until that support lands.Validation
29 passed, 2 skipped, 2 xfailed(the two xfails are the mixed end-to-end cases).Refs #118.