3 references to InferDeviceMapForEachLayer
Microsoft.ML.GenAI.LLaMA (1)
LlamaForCausalLM.cs (1)
149
var deviceMap = model.
InferDeviceMapForEachLayer
(
Microsoft.ML.GenAI.Mistral (1)
MistralForCausalLM.cs (1)
99
var deviceMap = model.
InferDeviceMapForEachLayer
(
Microsoft.ML.GenAI.Phi (1)
Phi3\Phi3ForCasualLM.cs (1)
101
var deviceMap = model.
InferDeviceMapForEachLayer
(