-
Notifications
You must be signed in to change notification settings - Fork 23
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #145 from DLTcollab/develop
Pre-release v0.3.0
- Loading branch information
Showing
12 changed files
with
144 additions
and
38 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,14 +1,14 @@ | ||
| language: c | ||
|
|
||
| os: | ||
| - linux | ||
| - osx | ||
|
|
||
| compiler: | ||
| - gcc | ||
|
|
||
| before_install: | ||
| - sudo apt-get install -y build-essential | ||
| - sudo apt-get install -y python3-pip | ||
| - sudo apt-get install -y python3-cffi | ||
| - sudo pip3 install --upgrade pip setuptools | ||
| - sudo pip3 install --ignore-installed pyota | ||
| - if [[ "$TRAVIS_OS_NAME" == "linux" ]]; then sudo apt-get install -y build-essential; fi | ||
|
|
||
| script: | ||
| - make check |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,28 @@ | ||
| # Threading model | ||
| In `dcurl`, it calls the APIs provided by the `libtuv` submodule to use the threads and thread pool. | ||
|
|
||
| ## Thread pool size | ||
| The thread pool size initialization is written in the function `init_once()`.\ | ||
| The environment variable `UV_THREADPOOL_SIZE` can be used to overwrite the default pool size.\ | ||
| Default pool size: 4\ | ||
| Maximum pool size: 128 | ||
|
|
||
| The current `dcurl` implementation can not affect the thread pool size. | ||
|
|
||
| ## Thread pool mechanism | ||
| The thread pool and the work request queue are global.\ | ||
| Work request can be treated as the function you would like to request the thread to execute. | ||
|
|
||
| In the thread pool initialization phase, the threads are created and execute the infinite loop function `worker()`.\ | ||
| The infinite loop makes the thread blocked with the function `uv_cond_wait()`, and it can be unblocked with the function `uv_cond_signal()`. | ||
|
|
||
| The function `uv_queue_work()` push the work request into the queue and unblock one of the blocked threads. | ||
| Then the unblocked thread pops out the work request from the queue and execute it.\ | ||
| If all the threads are busy, the first thread finishing its job would check the non-empty queue, pop out the work request and execute it. | ||
|
|
||
| In `dcurl`, it calls the function `uv_queue_work()` and passes the arguments with the PoW calculation function pointer and necessary data.\ | ||
| If the thread pool is large enough, the specified number of threads (which is the argument of `dcurl_entry()`) can be unblocked and fully utilized.\ | ||
| Otherwise, the `dcurl` would not be able to use as many threads as it specified at the same time. | ||
|
|
||
| ## Thread affinity | ||
| The current thread pool mechanism does not take thread affinity into consideration. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,43 @@ | ||
| package org.dltcollab; | ||
|
|
||
| import java.io.*; | ||
| import java.nio.file.Files; | ||
| import java.nio.file.StandardCopyOption; | ||
|
|
||
| public class Dcurl { | ||
| private static final String libraryName = "dcurl"; | ||
| private static final String libraryPrefix = "lib"; | ||
| private static final String librarySuffix = ".so"; | ||
| private static final String libraryFileName = libraryPrefix + libraryName + librarySuffix; | ||
|
|
||
| public void loadLibraryFromJar() { | ||
| final File temp; | ||
| try { | ||
| temp = File.createTempFile(libraryPrefix + libraryName, librarySuffix); | ||
| if (temp.exists() && !temp.delete()) { | ||
| throw new RuntimeException("File: " + temp.getAbsolutePath() + " already exists and cannot be removed."); | ||
| } | ||
| if (!temp.createNewFile()) { | ||
| throw new RuntimeException("File: " + temp.getAbsolutePath() + " could not be created."); | ||
| } | ||
|
|
||
| if (!temp.exists()) { | ||
| throw new RuntimeException("File " + temp.getAbsolutePath() + " does not exist."); | ||
| } else { | ||
| temp.deleteOnExit(); | ||
| } | ||
|
|
||
| // attempt to copy the library from the Jar file to the temp destination | ||
| try (final InputStream is = getClass().getClassLoader().getResourceAsStream(libraryFileName)) { | ||
| if (is == null) { | ||
| throw new RuntimeException(libraryFileName + " was not found inside JAR."); | ||
| } else { | ||
| Files.copy(is, temp.toPath(), StandardCopyOption.REPLACE_EXISTING); | ||
| } | ||
| } | ||
|
|
||
| System.load(temp.getAbsolutePath()); | ||
| } catch (IOException e) { | ||
| } | ||
| } | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,16 +1,17 @@ | ||
| # Default the path to the NVIDIA Run time Library | ||
| OPENCL_LIB_PATH ?= /usr/local/cuda/lib64 | ||
| OPENCL_LIB_DIR := $(shell test -d $(OPENCL_LIB_PATH); echo $$?) | ||
|
|
||
| ifneq ($(OPENCL_LIB_DIR),0) | ||
| $(error "Please specify the path to OpenCL library.") | ||
| endif | ||
|
|
||
| OPENCL_LIB_AVAIL := $(shell ls $(OPENCL_LIB_PATH) | grep -oi libOpenCL.so > /dev/null; echo $$?) | ||
| # The auto-detected path of the OpenCL library | ||
| OPENCL_LIB_PATH := $(shell pkg-config --variable=libdir OpenCL 2> /dev/null) | ||
| OPENCL_LIB_AVAIL := $(shell test -e $(OPENCL_LIB_PATH)/libOpenCL.so; echo $$?) | ||
| UNAME_S := $(shell uname -s) | ||
|
|
||
| ifneq ($(OPENCL_LIB_AVAIL),0) | ||
| $(error "Please check installation of OpenCL dynamic library in $(OPENCL_LIB_PATH)") | ||
| $(error "Please install the OpenCL library correctly.") | ||
| endif | ||
|
|
||
| CFLAGS += -DENABLE_OPENCL | ||
| LDFLAGS += -L$(OPENCL_LIB_PATH) -lOpenCL | ||
| ifeq ($(UNAME_S),Darwin) | ||
| # macOS | ||
| LDFLAGS += -F$(OPENCL_LIB_PATH) -framework OpenCL | ||
| else | ||
| # Default to Linux | ||
| LDFLAGS += -L$(OPENCL_LIB_PATH) -lOpenCL | ||
| endif |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters