9 Commits
Author SHA1 Message Date
contentisandGitHub 3b3ef9a77a Quantized Ops fixes (#10715)
* offload support, bug fixes, remove mixins

* add readme
2025-11-12 18:26:52 -05:00
contentisandGitHub 4cd881866b Use single apply_rope function across models (#10547) 2025-11-04 20:10:11 -05:00
contentisandGitHub 8817f8fc14 Mixed Precision Quantization System (#10498)
* Implement mixed precision operations with a registry design and metadate for quant spec in checkpoint.

* Updated design using Tensor Subclasses

* Fix FP8 MM

* An actually functional POC

* Remove CK reference and ensure correct compute dtype

* Update unit tests

* ruff lint

* Implement mixed precision operations with a registry design and metadate for quant spec in checkpoint.

* Updated design using Tensor Subclasses

* Fix FP8 MM

* An actually functional POC

* Remove CK reference and ensure correct compute dtype

* Update unit tests

* ruff lint

* Fix missing keys

* Rename quant dtype parameter

* Rename quant dtype parameter

* Fix unittests for CPU build
2025-10-28 16:20:53 -04:00
contentisandGitHub 97652d26b8 Add explicit casting in apply_rope for Qwen VL (#9759) 2025-09-08 15:08:18 -04:00
contentisandGitHub e2d1e5dad9 Enable Convolution AutoTuning (#9301) 2025-09-01 20:33:50 -04:00
contentisandGitHub fe31ad0276 Add elementwise fusions (#9495)
* Add elementwise fusions

* Add addcmul pattern to Qwen
2025-08-22 19:39:15 -04:00
contentisandGitHub 3da5a07510 SDPA backend priority (#9299) 2025-08-13 14:53:27 -04:00
contentisandGitHub 69694f40b3 fix dynamic shape export (#5490) 2024-11-04 14:59:28 -05:00
contentisandGitHub 5a8a48931a remove attention abstraction (#5324) 2024-10-22 14:02:38 -04:00