You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I see that the ggml_graph_compute_thread_hybrid function is added by you (I think this may be an importance function for PowerInfer), but my global search did not find the addition of GGML_USE_HYBRID_THREADING.
The text was updated successfully, but these errors were encountered:
The GGML_USE_HYBRID_THREADING flag acts as a switch to decide if all GPU computation nodes should be exclusively assigned to a single specific CPU worker. By default, this feature is not active, hence you won't find its definition within the source code. If you wish to activate this feature, it can be enabled through the definition in CMake's CXXFLAGS and CFLAGS as follows:
Where is the definition or addition location of GGML_USE_HYBRID_THREADING?
In the
int ggml_graph_compute(struct ggml_cgraph * cgraph, struct ggml_cplan * cplan)
function in theggml.c
fileI see that the
ggml_graph_compute_thread_hybrid
function is added by you (I think this may be an importance function for PowerInfer), but my global search did not find the addition ofGGML_USE_HYBRID_THREADING
.The text was updated successfully, but these errors were encountered: