0.9.0

    Release notes - Hopsworks - Version 0.9.0

Bug

• [HOPSWORKS-546] - Multiple Jupyter notebooks opened for the same user cause PersistenceException
• [HOPSWORKS-727] - Modify influxdb template to account for fqdn
• [HOPSWORKS-846] - Wrong metrics in multiple NN setup
• [HOPSWORKS-865] - Pip search fallback mechanism should catch Exception on the REST request
• [HOPSWORKS-868] - Remove usages of case node['platform'] to allow RHEL installation
• [HOPSWORKS-871] - GPUs can get stuck, need nvidia-smi command to restart them
• [HOPSWORKS-876] - Add nvidia/driver_version to metadata.rb
• [HOPSWORKS-888] - featurestore: Infer tf-record-schema does not work with bigint types
• [HOPSWORKS-891] - [Featurestore]: bug, can't infer join-string in edge-case
• [HOPSWORKS-895] - [Featurestore] bug, get_project_featurestore can return wrong result if project name contains upper-case letters
• [HOPSWORKS-896] - [kagent-chef] Fix broken Anaconda GC command
• [HOPSWORKS-899] - deep learning tour broken after running feature store tour
• [HOPSWORKS-902] - tensorboard.sh script uses hopworks users as group in chmod
• [HOPSWORKS-907] - Crypto material lock gets vanished in CertificateMaterializer
• [HOPSWORKS-910] - Lock down hive-site.xml
• [HOPSWORKS-925] - Hopsworks common dependency on jwt causes persistence unit issues
• [HOPSWORKS-933] - Enable/Disable Airflow microservice for projects

Sub-task

• [HOPSWORKS-752] - Add support for running notebooks (.ipynb) in Job service
• [HOPSWORKS-893] - Remove Zeppelin service icon from Hopsworks

New Feature

• [HOPSWORKS-853] - Feature Store Tour
• [HOPSWORKS-908] - AirFlow as a Hopsworks microservice

Improvement

• [HOPSWORKS-755] - Fix minor bugs/semantic issues in hops-util-py
• [HOPSWORKS-855] - Display readable error in case of naming conflict when sharing datasets
• [HOPSWORKS-870] - Support PIP configuration for internal PyPi servers/proxies
• [HOPSWORKS-872] - Job's configuration should be editable
• [HOPSWORKS-873] - Change featurestore.create_training_dataset semantics to allow overwrite
• [HOPSWORKS-879] - Add flag to not install epel-repo on Centos/Rhel
• [HOPSWORKS-880] - Make sure umask is 022 before creating envs/pip install
• [HOPSWORKS-887] - Add new variable to enable/disable downloading files
• [HOPSWORKS-894] - InferenceController implementations should use connection pooling
• [HOPSWORKS-906] - Use experiments service in feature store tour
• [HOPSWORKS-921] - Increase timeout for project re-index in epipe

Task

• [HOPSWORKS-838] - Upgrade Spark to 2.4.0
• [HOPSWORKS-866] - Support JobName in addition to JobId as arguments in the Feature Store API
• [HOPSWORKS-867] - Move from Oracle JDK to OpenJDK from the package manager
• [HOPSWORKS-898] - Add rpc size related configs in Livy
• [HOPSWORKS-918] - Bump Hops depdendency in Hopsworks to 2.8.2.7
• [HOPSWORKS-919] - [hopsworks-chef] Create Airflow connection pool in Glassfish on updates
• [HOPSWORKS-922] - (chef) Update kafka attributes

0.8.1

    Release notes - Hopsworks - Version 0.8.1

Bug

• [HOPSWORKS-727] - Modify influxdb template to account for fqdn
• [HOPSWORKS-865] - Pip search fallback mechanism should catch Exception on the REST request
• [HOPSWORKS-868] - Remove usages of case node['platform'] to allow RHEL installation
• [HOPSWORKS-871] - GPUs can get stuck, need nvidia-smi command to restart them
• [HOPSWORKS-876] - Add nvidia/driver_version to metadata.rb
• [HOPSWORKS-878] - Moving files in Hopsworks datasets browser does not work
• [HOPSWORKS-883] - [conda-chef] Installation of kagent_utils fail
• [HOPSWORKS-885] - Jobs service date field should account for clock skew

Improvement

• [HOPSWORKS-870] - Support PIP configuration for internal PyPi servers/proxies

Task

• [HOPSWORKS-867] - Move from Oracle JDK to OpenJDK from the package manager

0.8.0

    Release notes - Hopsworks - Version 0.8.0

Bug

• [HOPSWORKS-845] - IllegalStateException in TensorBoardProxyServlet
• [HOPSWORKS-850] - Experiments dashboard should be created when jobs service is added
• [HOPSWORKS-851] - Convert .ipynb to .py uses wrong jupyter binary path
• [HOPSWORKS-857] - Spark executor UI not displaying whe high number of executors
• [HOPSWORKS-861] - Deep Learning demo shows "Jupyter not installed" on Jupyter page

Sub-task

• [HOPSWORKS-510] - Jobs, Executions, Users, Activities
• [HOPSWORKS-719] - Implement feature store microservice UI on Hopsworks
• [HOPSWORKS-720] - Add REST API for the feature store
• [HOPSWORKS-721] - Add examples of how to use feature store
• [HOPSWORKS-743] - Python client for feature store
• [HOPSWORKS-744] - Java client for feature store

New Feature

• [HOPSWORKS-718] - Feature Store in HopsML

Task

• [HOPSWORKS-844] - Add ipyleaflet and folium examples to hops-examples notebooks
• [HOPSWORKS-848] - Intro documentation for HopsML
• [HOPSWORKS-862] - Fix front-end scripts

0.7.0

    Release notes - Hopsworks - Version 0.7.0

Bug

• [HOPSWORKS-713] - Tame setup-chef
• [HOPSWORKS-801] - Jupyter application view/kill buttons not visible in low resolutions
• [HOPSWORKS-803] - Add Elastic dependency to Berksfile in hops-hadoop-chef
• [HOPSWORKS-805] - Add rm dependency to nm in hops-hadoop-chef karamelfile
• [HOPSWORKS-807] - fix yarn.nodemanager.aux-services in mapred-site.xml
• [HOPSWORKS-808] - fix hops cluster definition in karamel-chef
• [HOPSWORKS-812] - TensorBoard poller running too often
• [HOPSWORKS-815] - Mail sent from dataset request addresses wrong user
• [HOPSWORKS-820] - Only one instance of JAXBContext should be created per JobConfiguration.
• [HOPSWORKS-823] - Jupyter cleanup for Project deletion never worked
• [HOPSWORKS-824] - [conda-chef] Template conda repo only if provided for hops-system environment
• [HOPSWORKS-825] - Review projectmember removal and jobs
• [HOPSWORKS-830] - conda hops-system env fails the upgrade from 0.6.* to 0.7.0
• [HOPSWORKS-833] - NPE when getting the state of CertificateMaterializer
• [HOPSWORKS-843] - TensorBoard cleans up certificates twice
• [HOPSWORKS-847] - Add Sparkmagic support for utf-8 chars in configuration file

Sub-task

• [HOPSWORKS-661] - JWT for REST API endpoints
• [HOPSWORKS-733] - Refactor JobService to use JAXB and SparkConfiguration
• [HOPSWORKS-745] - Make spark compatible with hopsHive
• [HOPSWORKS-765] - Base classes for REST API

Improvement

• [HOPSWORKS-679] - [kagent-chef] Use Anaconda environment for kagent
• [HOPSWORKS-728] - Support Random Search in hops-util-py
• [HOPSWORKS-750] - Jupyter server should use the project conda env
• [HOPSWORKS-767] - Support for installing multiple library versions with pip
• [HOPSWORKS-780] - [ePipe] InodeIds are long starting from HopsFS 2.8.2.6
• [HOPSWORKS-793] - TensorBoard in Experiments service too long lived
• [HOPSWORKS-800] - Commands executor service
• [HOPSWORKS-810] - Avoid launching a subprocess to read Hadoop classpath
• [HOPSWORKS-811] - Lazy Conda environment creation
• [HOPSWORKS-813] - Speed up TensorBoard in Experiments service
• [HOPSWORKS-831] - [ePipe] Use Uint64 as the processing index instead of long

Task

• [HOPSWORKS-683] - From hops 2.8.2.6 the inode id is a long
• [HOPSWORKS-735] - update steps for enabling 2-factor from profile
• [HOPSWORKS-749] - [hopsworks-chef] Add 0.7.0 flyway sql files
• [HOPSWORKS-787] - Deploy Hopsworks artifacts on the maven repo
• [HOPSWORKS-834] - Update ndb cookbook to deploy 7.6.8
• [HOPSWORKS-842] - Bump hops version for hops-util and hops-examples

0.6.1

    Release notes - Hopsworks - Version 0.6.1

Bug

• [HOPSWORKS-713] - Tame setup-chef
• [HOPSWORKS-809] - Misleading exception when Jupyter fails to start
• [HOPSWORKS-812] - TensorBoard poller running too often

Improvement

• [HOPSWORKS-811] - Lazy Conda environment creation

0.6.0

    Release notes - Hopsworks - Version 0.6.0

Bug

• [HOPSWORKS-224] - Vizops driver and executor tabs do not display data
• [HOPSWORKS-369] - Restrict characters allowed in project names
• [HOPSWORKS-429] - Fix configuration of TFSpark in JobService
• [HOPSWORKS-526] - checkstyle rules out of date for Java 8
• [HOPSWORKS-587] - Chef recipes bug fixes and common install version
• [HOPSWORKS-594] - Fix compilation bug in tensorflow::default
• [HOPSWORKS-599] - Kafka tour broken because of HOPSWORKS-587
• [HOPSWORKS-602] - Update Hopsworks settings in cluster definition breaks flyway migrate
• [HOPSWORKS-604] - Review OpenMPI and CUDA upgrade
• [HOPSWORKS-605] - Chef: fix remote path for hops-examples and hops-util
• [HOPSWORKS-608] - Put back the code for downloading hops-tensorflow.jar
• [HOPSWORKS-610] - The project logging to ops_log should be done after the project is assigned an inode
• [HOPSWORKS-614] - [kagent-chef] Be consistent on the separator in config.ini
• [HOPSWORKS-615] - Kagent-chef upgrade broken
• [HOPSWORKS-617] - Hopsworks-579 breaks build with -Pcluster profile
• [HOPSWORKS-619] - nvidia-smi might not be available in hops::install to generate /tmp/num_gpus
• [HOPSWORKS-620] - Hops cookbook broken for configuration update
• [HOPSWORKS-624] - Proxy not handling capital letters in url
• [HOPSWORKS-632] - Regex too strict for yarn quota updates in admin ui
• [HOPSWORKS-635] - Enable logging for Livy
• [HOPSWORKS-636] - Only install nccl2 if chef attribute cuda/download_terms/accept is 'true'
• [HOPSWORKS-646] - Inconsistent metadata due to parallel data readers
• [HOPSWORKS-647] - Unshare dataset UI not working
• [HOPSWORKS-650] - Job-monitor ui broken
• [HOPSWORKS-652] - [hopslog-chef] Change primary group of yarn user to hadoop
• [HOPSWORKS-653] - Driver and Executor links broken in Executors tab in Spark UI
• [HOPSWORKS-660] - Zip/Unzip changes ownership for files in same directory as the unzipped folder or zipped file
• [HOPSWORKS-663] - Admin UI is broken because of missing methods in Hosts
• [HOPSWORKS-666] - MMLSpark breaks reproducible environments
• [HOPSWORKS-668] - ProjectController ignores failures for adding Jupyter dataset and Hive service
• [HOPSWORKS-670] - Conda search broken on master
• [HOPSWORKS-675] - Handling of agent heartbeat could result in transactions timing-out
• [HOPSWORKS-677] - [hops-hadoop-chef] Hopsworks host is not interpolated in yarn-site.xml
• [HOPSWORKS-681] - Wrong filename for certificates (.cert.pem appended twice)
• [HOPSWORKS-682] - Installed Python libraries do not change status
• [HOPSWORKS-684] - TensorBoard broken for single Experiment in JobUI
• [HOPSWORKS-691] - "Unhealthy HDFS blocks" display badly in admin pannel when running multiple NN
• [HOPSWORKS-696] - /previewFile in DataSetService does not filter out control codes from JSON response
• [HOPSWORKS-701] - JobService proxy should not set host config for client
• [HOPSWORKS-704] - TensorBoard not showing events in Experiments service
• [HOPSWORKS-707] - Lib status for anaconda envs still is broken
• [HOPSWORKS-731] - Add additional Distributed Training configuration check to JupyterConfigFilesGenerator
• [HOPSWORKS-746] - TfLibMapping missing TensorFlow 1.8
• [HOPSWORKS-753] - Change default location of Unix MySQL socket for Rspec
• [HOPSWORKS-756] - Jupyter NPE when starting it before Python service is enabled
• [HOPSWORKS-760] - elastic-chef don't use the elasticsearch lwrp to create the user
• [HOPSWORKS-766] - If hopsworks.version is 0.6.0 replace flyway_schema_history table
• [HOPSWORKS-768] - appservice tests fail randomly
• [HOPSWORKS-772] - Chef replace provider uses local path
• [HOPSWORKS-773] - Usernames should not contain any special char
• [HOPSWORKS-777] - Hopsworks administrator should be able to delete Projects
• [HOPSWORKS-779] - [ePipe] Fix a race condition while reading from ndb
• [HOPSWORKS-783] - INFO log severity in UserStatusValidator is polluting the logs
• [HOPSWORKS-786] - Fix file path for 0.6.0 flyway migration table
• [HOPSWORKS-794] - flyway schema history should be replaced only if the last migration was 0.5.0
• [HOPSWORKS-795] - Jupyter does not have a preselected mode set
• [HOPSWORKS-797] - Swagger cannot generate json
• [HOPSWORKS-799] - Lowercase project name for TfServing logs

Sub-task

• [HOPSWORKS-244] - Replace deprecated _ttl field in elasticsearch
• [HOPSWORKS-251] - Replace log4j socketAppender for Logstash
• [HOPSWORKS-299] - Add fu...