Add more info to preallocate_params

lib/bumblebee/audio.ex

@@ -107,7 +107,10 @@ defmodule Bumblebee.Audio do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
     * `:stream` - when `true`, the serving immediately returns a
       stream that emits chunks as they are generated. Note that

lib/bumblebee/diffusion/stable_diffusion.ex

@@ -65,7 +65,10 @@ defmodule Bumblebee.Diffusion.StableDiffusion do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 

lib/bumblebee/text.ex

@@ -94,7 +94,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -160,7 +163,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
     * `:stream` - when `true`, the serving immediately returns a
       stream that emits text chunks as they are generated. Note that
@@ -255,7 +261,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -329,7 +338,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -402,7 +414,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -472,7 +487,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -546,7 +564,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -619,7 +640,10 @@ defmodule Bumblebee.Text do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 

lib/bumblebee/vision.ex

@@ -53,7 +53,10 @@ defmodule Bumblebee.Vision do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -114,7 +117,10 @@ defmodule Bumblebee.Vision do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples
 
@@ -179,7 +185,10 @@ defmodule Bumblebee.Vision do
     * `:preallocate_params` - when `true`, explicitly allocates params
       on the device configured by `:defn_options`. You may want to set
       this option when using partitioned serving, to allocate params
-      on each of the devices. Defaults to `false`
+      on each of the devices. When using this option, you should first
+      load the parameters into the host. This can be done by passing
+      `backend: {EXLA.Backend, client: :host}` to `load_model/1` and friends.
+      Defaults to `false`
 
   ## Examples