Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unresponsive orientdb / Segment added thread consuming 1 cpu core #9156

Closed
madmac2501 opened this issue Feb 27, 2020 · 14 comments
Closed

Unresponsive orientdb / Segment added thread consuming 1 cpu core #9156

madmac2501 opened this issue Feb 27, 2020 · 14 comments
Assignees
@andrii0lomakin

Comments

@madmac2501
Copy link

madmac2501 commented Feb 27, 2020 •
edited by wolf4ood
Loading

OrientDB Version: 3.0.28

Java Version: 1.8.0_222

OS: Linux

Expected behavior

OrientDB doesn't block

Actual behavior

OrientDB become unresponsive

Steps to reproduce

I'm making periodic upserts, after a few hours OrientDB become unresponsive with "Segment adder thread" at 100% in one core, all other threads were not consuming cpu. It's also impossible to login into the web ui.

Here is a thread dump

Best regards

2020-02-27 11:29:50
Full thread dump OpenJDK 64-Bit Server VM (25.222-b10 mixed mode):

"Attach Listener" #339 daemon prio=9 os_prio=0 tid=0x00007f8cfc001000 nid=0x2b5 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.0.0.147:2480<-/10.0.0.18:40560" #336 daemon prio=5 os_prio=0 tid=0x00007f84f402f800 nid=0x1f8 waiting on condition [0x00007f8d28cf9000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000880121d8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:168)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:100)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.acquireReadLock(OAtomicOperationsManager.java:408)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.getEntries(OPaginatedClusterV1.java:1201)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.count(OAbstractPaginatedStorage.java:1707)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClusterElements(ODatabaseDocumentAbstract.java:376)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClusterElements(ODatabaseDocumentAbstract.java:330)
	at com.orientechnologies.orient.core.metadata.schema.OImmutableClass.count(OImmutableClass.java:483)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClass(ODatabaseDocumentAbstract.java:2109)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClass(ODatabaseDocumentAbstract.java:2097)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.exportClass(OServerCommandGetDatabase.java:81)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.exec(OServerCommandGetDatabase.java:216)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.execute(OServerCommandGetDatabase.java:150)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:228)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:707)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.0.0.147:2480<-/10.0.0.18:40554" #335 daemon prio=5 os_prio=0 tid=0x00007f84f4019800 nid=0x1f7 runnable [0x00007f8d28bf9000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
	- locked <0x00000000fe2d9338> (a java.io.BufferedInputStream)
	at com.orientechnologies.orient.enterprise.channel.text.OChannelText.read(OChannelText.java:61)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:651)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.0.0.147:2480<-/10.0.0.18:40530" #329 daemon prio=5 os_prio=0 tid=0x00007f84f4025000 nid=0x1f1 waiting on condition [0x00007f8d237f5000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000880121d8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:168)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:100)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.acquireReadLock(OAtomicOperationsManager.java:408)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.getEntries(OPaginatedClusterV1.java:1201)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.count(OAbstractPaginatedStorage.java:1707)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClusterElements(ODatabaseDocumentAbstract.java:376)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClusterElements(ODatabaseDocumentAbstract.java:330)
	at com.orientechnologies.orient.core.metadata.schema.OImmutableClass.count(OImmutableClass.java:483)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClass(ODatabaseDocumentAbstract.java:2109)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClass(ODatabaseDocumentAbstract.java:2097)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.exportClass(OServerCommandGetDatabase.java:81)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.exec(OServerCommandGetDatabase.java:216)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.execute(OServerCommandGetDatabase.java:150)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:228)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:707)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:41782)" #328 daemon prio=5 os_prio=0 tid=0x00007f8500011000 nid=0x1f0 waiting on condition [0x00007f8d238f7000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000087774a78> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
	at com.orientechnologies.orient.server.OClientConnection.acquire(OClientConnection.java:87)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.onBeforeOperationalRequest(ONetworkProtocolBinary.java:461)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:266)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:41644)" #327 daemon prio=5 os_prio=0 tid=0x00007f850000f800 nid=0x1ef waiting on condition [0x00007f8d236f5000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000088d95070> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
	at com.orientechnologies.orient.server.OClientConnection.acquire(OClientConnection.java:87)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.onBeforeOperationalRequest(ONetworkProtocolBinary.java:461)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:266)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:41642)" #326 daemon prio=5 os_prio=0 tid=0x00007f850000e800 nid=0x1ee waiting on condition [0x00007f8d286f6000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000088db22d8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
	at com.orientechnologies.orient.server.OClientConnection.acquire(OClientConnection.java:87)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.onBeforeOperationalRequest(ONetworkProtocolBinary.java:461)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:266)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.0.0.147:2480<-/10.0.0.18:40524" #325 daemon prio=5 os_prio=0 tid=0x00007f84f402c000 nid=0x1ed waiting on condition [0x00007f8d23bf9000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000880121d8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:168)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:100)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.acquireReadLock(OAtomicOperationsManager.java:408)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.getEntries(OPaginatedClusterV1.java:1201)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.count(OAbstractPaginatedStorage.java:1707)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClusterElements(ODatabaseDocumentAbstract.java:376)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClusterElements(ODatabaseDocumentAbstract.java:330)
	at com.orientechnologies.orient.core.metadata.schema.OImmutableClass.count(OImmutableClass.java:483)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClass(ODatabaseDocumentAbstract.java:2109)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.countClass(ODatabaseDocumentAbstract.java:2097)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.exportClass(OServerCommandGetDatabase.java:81)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.exec(OServerCommandGetDatabase.java:216)
	at com.orientechnologies.orient.server.network.protocol.http.command.get.OServerCommandGetDatabase.execute(OServerCommandGetDatabase.java:150)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:228)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:707)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:41392)" #320 daemon prio=5 os_prio=0 tid=0x00007f850000d800 nid=0x1a1 waiting on condition [0x00007f8d239f8000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000088de0a00> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
	at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:209)
	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
	at com.orientechnologies.orient.server.OClientConnection.acquire(OClientConnection.java:87)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.onBeforeOperationalRequest(ONetworkProtocolBinary.java:461)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:266)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.0.0.147:2480<-/10.0.0.18:3975" #319 daemon prio=5 os_prio=0 tid=0x00007f84f4021800 nid=0x1a0 runnable [0x00007f8d23efd000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
	- locked <0x00000000fe3155a0> (a java.io.BufferedInputStream)
	at com.orientechnologies.orient.enterprise.channel.text.OChannelText.read(OChannelText.java:61)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:651)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.0.0.147:2480<-/10.0.0.2:53337" #318 daemon prio=5 os_prio=0 tid=0x00007f84f4023000 nid=0x19f runnable [0x00007f8d23dfc000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
	- locked <0x00000000fe31cf20> (a java.io.BufferedInputStream)
	at com.orientechnologies.orient.enterprise.channel.text.OChannelText.read(OChannelText.java:61)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:651)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.69.2.91:2480<-/10.69.1.75:51478" #209 daemon prio=5 os_prio=0 tid=0x00007f84f401e000 nid=0x132 waiting on condition [0x00007f8d23af8000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000087f84ff0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:168)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:100)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.acquireReadLock(OAtomicOperationsManager.java:408)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.readRecord(OPaginatedClusterV1.java:517)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.readRecord(OPaginatedClusterV1.java:512)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doReadRecord(OAbstractPaginatedStorage.java:5028)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:4741)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1914)
	at com.orientechnologies.orient.core.db.document.SimpleRecordReader.readRecord(SimpleRecordReader.java:21)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.executeReadRecord(ODatabaseDocumentAbstract.java:1344)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:109)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.load(ODatabaseDocumentAbstract.java:1113)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.load(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.record.impl.ODocument.getProperty(ODocument.java:361)
	at com.orientechnologies.orient.core.record.impl.OEdgeDocument.getTo(OEdgeDocument.java:33)
	at com.devo.orientdb.plugins.WriteToDevoFunction.writeToAssociationsTable(WriteToDevoFunction.java:141)
	at com.devo.orientdb.plugins.WriteToDevoFunction.execute(WriteToDevoFunction.java:96)
	at com.orientechnologies.orient.core.sql.parser.OFunctionCall.execute(OFunctionCall.java:136)
	at com.orientechnologies.orient.core.sql.parser.OFunctionCall.execute(OFunctionCall.java:90)
	at com.orientechnologies.orient.core.sql.parser.OLevelZeroIdentifier.execute(OLevelZeroIdentifier.java:60)
	at com.orientechnologies.orient.core.sql.parser.OBaseIdentifier.execute(OBaseIdentifier.java:70)
	at com.orientechnologies.orient.core.sql.parser.OBaseExpression.execute(OBaseExpression.java:120)
	at com.orientechnologies.orient.core.sql.parser.OExpression.execute(OExpression.java:110)
	at com.orientechnologies.orient.core.sql.parser.OProjectionItem.execute(OProjectionItem.java:156)
	at com.orientechnologies.orient.core.sql.parser.OProjection.calculateSingle(OProjection.java:116)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep.calculateProjections(ProjectionCalculationStep.java:66)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep.access$000(ProjectionCalculationStep.java:13)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep$1.next(ProjectionCalculationStep.java:41)
	at com.orientechnologies.orient.core.sql.executor.AggregateProjectionCalculationStep.executeAggregation(AggregateProjectionCalculationStep.java:85)
	at com.orientechnologies.orient.core.sql.executor.AggregateProjectionCalculationStep.syncPull(AggregateProjectionCalculationStep.java:36)
	at com.orientechnologies.orient.core.sql.executor.GuaranteeEmptyCountStep.syncPull(GuaranteeEmptyCountStep.java:26)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep.syncPull(ProjectionCalculationStep.java:29)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.sql.parser.OSelectStatement.execute(OSelectStatement.java:276)
	at com.orientechnologies.orient.core.sql.parser.OStatement.execute(OStatement.java:79)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.command(ODatabaseDocumentEmbedded.java:567)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommand.executeStatement(OServerCommandPostCommand.java:189)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommand.execute(OServerCommandPostCommand.java:95)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommandGraph.execute(OServerCommandPostCommandGraph.java:36)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:228)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:707)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.69.2.91:2480<-/10.69.1.75:51384" #194 daemon prio=5 os_prio=0 tid=0x00007f84f4020000 nid=0x123 waiting on condition [0x00007f8d287f6000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000087f75868> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:168)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:100)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.acquireReadLock(OAtomicOperationsManager.java:408)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.readRecord(OPaginatedClusterV1.java:517)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.readRecord(OPaginatedClusterV1.java:512)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doReadRecord(OAbstractPaginatedStorage.java:5028)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:4741)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1914)
	at com.orientechnologies.orient.core.db.document.SimpleRecordReader.readRecord(SimpleRecordReader.java:21)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.executeReadRecord(ODatabaseDocumentAbstract.java:1344)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:109)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.load(ODatabaseDocumentAbstract.java:1113)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.load(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.record.impl.ODocument.getProperty(ODocument.java:361)
	at com.orientechnologies.orient.core.record.impl.OEdgeDocument.getTo(OEdgeDocument.java:33)
	at com.devo.orientdb.plugins.WriteToDevoFunction.writeToAssociationsTable(WriteToDevoFunction.java:141)
	at com.devo.orientdb.plugins.WriteToDevoFunction.execute(WriteToDevoFunction.java:96)
	at com.orientechnologies.orient.core.sql.parser.OFunctionCall.execute(OFunctionCall.java:136)
	at com.orientechnologies.orient.core.sql.parser.OFunctionCall.execute(OFunctionCall.java:90)
	at com.orientechnologies.orient.core.sql.parser.OLevelZeroIdentifier.execute(OLevelZeroIdentifier.java:60)
	at com.orientechnologies.orient.core.sql.parser.OBaseIdentifier.execute(OBaseIdentifier.java:70)
	at com.orientechnologies.orient.core.sql.parser.OBaseExpression.execute(OBaseExpression.java:120)
	at com.orientechnologies.orient.core.sql.parser.OExpression.execute(OExpression.java:110)
	at com.orientechnologies.orient.core.sql.parser.OProjectionItem.execute(OProjectionItem.java:156)
	at com.orientechnologies.orient.core.sql.parser.OProjection.calculateSingle(OProjection.java:116)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep.calculateProjections(ProjectionCalculationStep.java:66)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep.access$000(ProjectionCalculationStep.java:13)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep$1.next(ProjectionCalculationStep.java:41)
	at com.orientechnologies.orient.core.sql.executor.AggregateProjectionCalculationStep.executeAggregation(AggregateProjectionCalculationStep.java:85)
	at com.orientechnologies.orient.core.sql.executor.AggregateProjectionCalculationStep.syncPull(AggregateProjectionCalculationStep.java:36)
	at com.orientechnologies.orient.core.sql.executor.GuaranteeEmptyCountStep.syncPull(GuaranteeEmptyCountStep.java:26)
	at com.orientechnologies.orient.core.sql.executor.ProjectionCalculationStep.syncPull(ProjectionCalculationStep.java:29)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.sql.parser.OSelectStatement.execute(OSelectStatement.java:276)
	at com.orientechnologies.orient.core.sql.parser.OStatement.execute(OStatement.java:79)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.command(ODatabaseDocumentEmbedded.java:567)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommand.executeStatement(OServerCommandPostCommand.java:189)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommand.execute(OServerCommandPostCommand.java:95)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommandGraph.execute(OServerCommandPostCommandGraph.java:36)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:228)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:707)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:36616)" #164 daemon prio=5 os_prio=0 tid=0x00007f850000c800 nid=0x105 waiting on condition [0x00007f8d23ffd000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000841e4360> (a com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer.startOperation(OperationsFreezer.java:41)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.startComponentOperation(OAtomicOperationsManager.java:267)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.executeInsideComponentOperation(OAtomicOperationsManager.java:171)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.executeInsideComponentOperation(OAtomicOperationsManager.java:165)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.executeInsideComponentOperation(ODurableComponent.java:103)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.updateRecord(OPaginatedClusterV1.java:727)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doUpdateRecord(OAbstractPaginatedStorage.java:4887)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:5402)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2434)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2267)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.internalCommit(ODatabaseDocumentAbstract.java:2702)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.doCommit(OMicroTransaction.java:363)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.commit(OMicroTransaction.java:166)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.endMicroTransaction(ODatabaseDocumentEmbedded.java:798)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.executeSaveRecord(ODatabaseDocumentEmbedded.java:788)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.saveRecord(OTransactionNoTx.java:184)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.saveInternal(ODatabaseDocumentAbstract.java:2077)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:2039)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:1929)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.sql.executor.SaveElementStep$1.next(SaveElementStep.java:40)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.fetchNextItem(ConvertToResultInternalStep.java:62)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.hasNext(ConvertToResultInternalStep.java:88)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:47)
	at com.orientechnologies.orient.core.sql.parser.OUpdateStatement.execute(OUpdateStatement.java:169)
	at com.orientechnologies.orient.core.sql.parser.OLetStatement.executeSimple(OLetStatement.java:36)
	at com.orientechnologies.orient.core.sql.executor.OSingleOpExecutionPlan.executeInternal(OSingleOpExecutionPlan.java:99)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:37)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.executeFull(OScriptExecutionPlan.java:215)
	at com.orientechnologies.orient.core.sql.executor.ForEachStep.syncPull(ForEachStep.java:47)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:46)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:33)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.doExecute(OScriptExecutionPlan.java:89)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.fetchNext(OScriptExecutionPlan.java:50)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.executeInternal(OSqlScriptExecutor.java:114)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.execute(OSqlScriptExecutor.java:60)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.execute(ODatabaseDocumentEmbedded.java:638)
	at com.orientechnologies.orient.server.OConnectionBinaryExecutor.executeQuery(OConnectionBinaryExecutor.java:1192)
	at com.orientechnologies.orient.client.remote.message.OQueryRequest.execute(OQueryRequest.java:136)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:310)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- <0x0000000087774a78> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
	- <0x0000000087f75868> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x0000000087f75980> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x0000000087f75aa8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)

"Segment adder thread" #160 daemon prio=5 os_prio=0 tid=0x00007f8450033000 nid=0x101 runnable [0x00007f8d23cfb000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.Thread.yield(Native Method)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer.freezeOperations(OperationsFreezer.java:64)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.freezeComponentOperations(OAtomicOperationsManager.java:275)
	at com.orientechnologies.orient.core.storage.disk.OLocalPaginatedStorage$SegmentAdder.call(OLocalPaginatedStorage.java:677)
	at com.orientechnologies.orient.core.storage.disk.OLocalPaginatedStorage$SegmentAdder.call(OLocalPaginatedStorage.java:655)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
	- <0x00000000ce01c210> (a java.util.concurrent.ThreadPoolExecutor$Worker)

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:34036)" #120 daemon prio=5 os_prio=0 tid=0x00007f850000b800 nid=0xd9 runnable [0x00007f8d288f8000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
	- locked <0x000000008a65ff30> (a java.io.BufferedInputStream)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:183)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB HTTP Connection /10.69.2.91:2480<-/10.69.1.75:50818" #119 daemon prio=5 os_prio=0 tid=0x00007f84f401a800 nid=0xd8 waiting on condition [0x00007f8d285f4000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000841e4360> (a com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer.startOperation(OperationsFreezer.java:41)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.startComponentOperation(OAtomicOperationsManager.java:267)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.calculateInsideComponentOperation(OAtomicOperationsManager.java:215)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.calculateInsideComponentOperation(OAtomicOperationsManager.java:209)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.calculateInsideComponentOperation(ODurableComponent.java:99)
	at com.orientechnologies.orient.core.storage.index.sbtree.local.OSBTree.remove(OSBTree.java:546)
	at com.orientechnologies.orient.core.storage.index.sbtree.multivalue.v2.CellBTreeMultiValueV2.lambda$remove$7(CellBTreeMultiValueV2.java:718)
	at com.orientechnologies.orient.core.storage.index.sbtree.multivalue.v2.CellBTreeMultiValueV2$$Lambda$270/1722488081.accept(Unknown Source)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.calculateInsideComponentOperation(OAtomicOperationsManager.java:217)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.calculateInsideComponentOperation(OAtomicOperationsManager.java:209)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.calculateInsideComponentOperation(ODurableComponent.java:99)
	at com.orientechnologies.orient.core.storage.index.sbtree.multivalue.v2.CellBTreeMultiValueV2.remove(CellBTreeMultiValueV2.java:621)
	at com.orientechnologies.orient.core.index.engine.v1.OCellBTreeMultiValueIndexEngine.remove(OCellBTreeMultiValueIndexEngine.java:111)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doRemoveRidIndexEntry(OAbstractPaginatedStorage.java:3203)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.removeRidIndexEntry(OAbstractPaginatedStorage.java:3168)
	at com.orientechnologies.orient.core.index.OIndexMultiValues.doRemoveV1(OIndexMultiValues.java:263)
	at com.orientechnologies.orient.core.index.OIndexMultiValues.remove(OIndexMultiValues.java:219)
	at com.orientechnologies.orient.core.index.OIndexAbstract.removeFromSnapshot(OIndexAbstract.java:852)
	at com.orientechnologies.orient.core.index.OIndexAbstract.applyIndexTxEntry(OIndexAbstract.java:697)
	at com.orientechnologies.orient.core.index.OIndexAbstract.addTxOperation(OIndexAbstract.java:667)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitIndexes(OAbstractPaginatedStorage.java:2512)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2442)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2267)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.internalCommit(ODatabaseDocumentAbstract.java:2702)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.doCommit(OMicroTransaction.java:363)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.commit(OMicroTransaction.java:166)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.endMicroTransaction(ODatabaseDocumentEmbedded.java:798)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.executeSaveRecord(ODatabaseDocumentEmbedded.java:788)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.saveRecord(OTransactionNoTx.java:184)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.saveInternal(ODatabaseDocumentAbstract.java:2077)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:2039)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:1929)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.sql.executor.SaveElementStep$1.next(SaveElementStep.java:40)
	at com.orientechnologies.orient.core.sql.executor.CountStep.syncPull(CountStep.java:53)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:46)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:33)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.executeUntilReturn(OScriptExecutionPlan.java:188)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.doExecute(OScriptExecutionPlan.java:86)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.fetchNext(OScriptExecutionPlan.java:50)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.executeInternal(OSqlScriptExecutor.java:114)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.execute(OSqlScriptExecutor.java:45)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.execute(ODatabaseDocumentEmbedded.java:618)
	at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostBatch.execute(OServerCommandPostBatch.java:203)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:228)
	at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:707)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- <0x0000000087f63f00> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x0000000087f84ff0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x0000000087f85108> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x000000008800abf0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x000000008800b490> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x000000008800b808> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:32780)" #102 daemon prio=5 os_prio=0 tid=0x00007f850000a800 nid=0xc7 waiting on condition [0x00007f8d284f3000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000841e4360> (a com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer.startOperation(OperationsFreezer.java:41)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.startComponentOperation(OAtomicOperationsManager.java:267)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.executeInsideComponentOperation(OAtomicOperationsManager.java:171)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.executeInsideComponentOperation(OAtomicOperationsManager.java:165)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.executeInsideComponentOperation(ODurableComponent.java:103)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.updateRecord(OPaginatedClusterV1.java:727)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doUpdateRecord(OAbstractPaginatedStorage.java:4887)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:5402)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2434)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2267)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.internalCommit(ODatabaseDocumentAbstract.java:2702)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.doCommit(OMicroTransaction.java:363)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.commit(OMicroTransaction.java:166)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.endMicroTransaction(ODatabaseDocumentEmbedded.java:798)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.executeSaveRecord(ODatabaseDocumentEmbedded.java:788)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.saveRecord(OTransactionNoTx.java:184)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.saveInternal(ODatabaseDocumentAbstract.java:2077)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:2039)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:1929)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.sql.executor.SaveElementStep$1.next(SaveElementStep.java:40)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.fetchNextItem(ConvertToResultInternalStep.java:62)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.hasNext(ConvertToResultInternalStep.java:88)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:47)
	at com.orientechnologies.orient.core.sql.parser.OUpdateStatement.execute(OUpdateStatement.java:169)
	at com.orientechnologies.orient.core.sql.parser.OLetStatement.executeSimple(OLetStatement.java:36)
	at com.orientechnologies.orient.core.sql.executor.OSingleOpExecutionPlan.executeInternal(OSingleOpExecutionPlan.java:99)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:37)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.executeFull(OScriptExecutionPlan.java:215)
	at com.orientechnologies.orient.core.sql.executor.ForEachStep.syncPull(ForEachStep.java:47)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:46)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:33)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.doExecute(OScriptExecutionPlan.java:89)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.fetchNext(OScriptExecutionPlan.java:50)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.executeInternal(OSqlScriptExecutor.java:114)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.execute(OSqlScriptExecutor.java:60)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.execute(ODatabaseDocumentEmbedded.java:638)
	at com.orientechnologies.orient.server.OConnectionBinaryExecutor.executeQuery(OConnectionBinaryExecutor.java:1192)
	at com.orientechnologies.orient.client.remote.message.OQueryRequest.execute(OQueryRequest.java:136)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:310)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- <0x0000000087fb3b18> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x00000000880121d8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x0000000088d95070> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:32778)" #101 daemon prio=5 os_prio=0 tid=0x00007f8500006000 nid=0xc6 waiting on condition [0x00007f8d282f1000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000841e4360> (a com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.operationsfreezer.OperationsFreezer.startOperation(OperationsFreezer.java:41)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.startComponentOperation(OAtomicOperationsManager.java:267)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.executeInsideComponentOperation(OAtomicOperationsManager.java:171)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.executeInsideComponentOperation(OAtomicOperationsManager.java:165)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.executeInsideComponentOperation(ODurableComponent.java:103)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.updateRecord(OPaginatedClusterV1.java:727)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doUpdateRecord(OAbstractPaginatedStorage.java:4887)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:5402)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2434)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2267)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.internalCommit(ODatabaseDocumentAbstract.java:2702)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.doCommit(OMicroTransaction.java:363)
	at com.orientechnologies.orient.core.storage.impl.local.OMicroTransaction.commit(OMicroTransaction.java:166)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.endMicroTransaction(ODatabaseDocumentEmbedded.java:798)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.executeSaveRecord(ODatabaseDocumentEmbedded.java:788)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.saveRecord(OTransactionNoTx.java:184)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.saveInternal(ODatabaseDocumentAbstract.java:2077)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:2039)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:1929)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.save(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.sql.executor.SaveElementStep$1.next(SaveElementStep.java:40)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.fetchNextItem(ConvertToResultInternalStep.java:62)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.hasNext(ConvertToResultInternalStep.java:88)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:47)
	at com.orientechnologies.orient.core.sql.parser.OUpdateStatement.execute(OUpdateStatement.java:169)
	at com.orientechnologies.orient.core.sql.parser.OLetStatement.executeSimple(OLetStatement.java:36)
	at com.orientechnologies.orient.core.sql.executor.OSingleOpExecutionPlan.executeInternal(OSingleOpExecutionPlan.java:99)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:37)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.executeFull(OScriptExecutionPlan.java:215)
	at com.orientechnologies.orient.core.sql.executor.ForEachStep.syncPull(ForEachStep.java:47)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:46)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:33)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.doExecute(OScriptExecutionPlan.java:89)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.fetchNext(OScriptExecutionPlan.java:50)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.executeInternal(OSqlScriptExecutor.java:114)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.execute(OSqlScriptExecutor.java:60)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.execute(ODatabaseDocumentEmbedded.java:638)
	at com.orientechnologies.orient.server.OConnectionBinaryExecutor.executeQuery(OConnectionBinaryExecutor.java:1192)
	at com.orientechnologies.orient.client.remote.message.OQueryRequest.execute(OQueryRequest.java:136)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:310)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- <0x000000008800a8d0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x000000008800a9f0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	- <0x0000000088db22d8> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:32776)" #99 daemon prio=5 os_prio=0 tid=0x00007f8500007000 nid=0xc4 waiting on condition [0x00007f8d283f2000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000008800a8d0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:168)
	at com.orientechnologies.common.concur.lock.OOneEntryPerKeyLockManager.acquireLock(OOneEntryPerKeyLockManager.java:100)
	at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.acquireReadLock(OAtomicOperationsManager.java:408)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.readRecord(OPaginatedClusterV1.java:517)
	at com.orientechnologies.orient.core.storage.cluster.v1.OPaginatedClusterV1.readRecord(OPaginatedClusterV1.java:512)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doReadRecord(OAbstractPaginatedStorage.java:5028)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:4741)
	at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1914)
	at com.orientechnologies.orient.core.db.document.SimpleRecordReader.readRecord(SimpleRecordReader.java:21)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.executeReadRecord(ODatabaseDocumentAbstract.java:1344)
	at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:109)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.load(ODatabaseDocumentAbstract.java:1113)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentAbstract.load(ODatabaseDocumentAbstract.java:86)
	at com.orientechnologies.orient.core.id.ORecordId.getRecord(ORecordId.java:331)
	at com.orientechnologies.orient.core.sql.executor.OResultInternal.setElement(OResultInternal.java:456)
	at com.orientechnologies.orient.core.sql.executor.GetValueFromIndexEntryStep$1.fetchNextItem(GetValueFromIndexEntryStep.java:129)
	at com.orientechnologies.orient.core.sql.executor.GetValueFromIndexEntryStep$1.hasNext(GetValueFromIndexEntryStep.java:58)
	at com.orientechnologies.orient.core.sql.executor.FilterStep$1.fetchNextItem(FilterStep.java:47)
	at com.orientechnologies.orient.core.sql.executor.FilterStep$1.hasNext(FilterStep.java:83)
	at com.orientechnologies.orient.core.sql.executor.FilterByClassStep$1.fetchNextItem(FilterByClassStep.java:50)
	at com.orientechnologies.orient.core.sql.executor.FilterByClassStep$1.hasNext(FilterByClassStep.java:88)
	at com.orientechnologies.orient.core.sql.executor.UpsertStep.syncPull(UpsertStep.java:36)
	at com.orientechnologies.orient.core.sql.executor.ConvertToUpdatableResultStep$1.fetchNextItem(ConvertToUpdatableResultStep.java:49)
	at com.orientechnologies.orient.core.sql.executor.ConvertToUpdatableResultStep$1.hasNext(ConvertToUpdatableResultStep.java:90)
	at com.orientechnologies.orient.core.sql.executor.UpdateSetStep$1.hasNext(UpdateSetStep.java:28)
	at com.orientechnologies.orient.core.sql.executor.SaveElementStep$1.hasNext(SaveElementStep.java:32)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.fetchNextItem(ConvertToResultInternalStep.java:49)
	at com.orientechnologies.orient.core.sql.executor.ConvertToResultInternalStep$1.hasNext(ConvertToResultInternalStep.java:88)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:47)
	at com.orientechnologies.orient.core.sql.parser.OUpdateStatement.execute(OUpdateStatement.java:169)
	at com.orientechnologies.orient.core.sql.parser.OLetStatement.executeSimple(OLetStatement.java:36)
	at com.orientechnologies.orient.core.sql.executor.OSingleOpExecutionPlan.executeInternal(OSingleOpExecutionPlan.java:99)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:37)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.executeFull(OScriptExecutionPlan.java:215)
	at com.orientechnologies.orient.core.sql.executor.ForEachStep.syncPull(ForEachStep.java:47)
	at com.orientechnologies.orient.core.sql.executor.OSelectExecutionPlan.fetchNext(OSelectExecutionPlan.java:37)
	at com.orientechnologies.orient.core.sql.executor.OUpdateExecutionPlan.executeInternal(OUpdateExecutionPlan.java:46)
	at com.orientechnologies.orient.core.sql.executor.ScriptLineStep.syncPull(ScriptLineStep.java:33)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.doExecute(OScriptExecutionPlan.java:89)
	at com.orientechnologies.orient.core.sql.executor.OScriptExecutionPlan.fetchNext(OScriptExecutionPlan.java:50)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.fetchNext(OLocalResultSet.java:39)
	at com.orientechnologies.orient.core.sql.parser.OLocalResultSet.<init>(OLocalResultSet.java:30)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.executeInternal(OSqlScriptExecutor.java:114)
	at com.orientechnologies.orient.core.command.OSqlScriptExecutor.execute(OSqlScriptExecutor.java:60)
	at com.orientechnologies.orient.core.db.document.ODatabaseDocumentEmbedded.execute(ODatabaseDocumentEmbedded.java:638)
	at com.orientechnologies.orient.server.OConnectionBinaryExecutor.executeQuery(OConnectionBinaryExecutor.java:1192)
	at com.orientechnologies.orient.client.remote.message.OQueryRequest.execute(OQueryRequest.java:136)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.sessionRequest(ONetworkProtocolBinary.java:310)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:212)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- <0x0000000088de0a00> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:59514)" #87 daemon prio=5 os_prio=0 tid=0x00007f8500004800 nid=0xb8 runnable [0x00007f8d281f1000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
	- locked <0x0000000088c24288> (a java.io.BufferedInputStream)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:183)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB (/10.69.2.91:2424) <- BinaryClient (/10.69.0.240:53146)" #61 daemon prio=5 os_prio=0 tid=0x00007f8500007800 nid=0x9e runnable [0x00007f8d235f4000]
   java.lang.Thread.State: RUNNABLE
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
	- locked <0x0000000087774590> (a java.io.BufferedInputStream)
	at java.io.DataInputStream.readByte(DataInputStream.java:265)
	at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)
	at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.execute(ONetworkProtocolBinary.java:183)
	at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

   Locked ownable synchronizers:
	- None

"OrientDB ONetworkProtocolHttpDb listen at 0.0.0.0:2480-2490" #38 prio=5 os_prio=0 tid=0x00007f88c3ff4800 nid=0x55 runnable [0x00007f8d28efc000]
   java.lang.Thread.State: RUNNABLE
	at java.net.PlainSocketImpl.socketAccept(Native Method)
	at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
	at java.net.ServerSocket.implAccept(ServerSocket.java:545)
	at java.net.ServerSocket.accept(ServerSocket.java:513)
	at com.orientechnologies.orient.server.network.OServerNetworkListener.run(OServerNetworkListener.java:188)

   Locked ownable synchronizers:
	- None

"OrientDB ONetworkProtocolBinary listen at 0.0.0.0:2424-2430" #36 prio=5 os_prio=0 tid=0x00007f8933ff4800 nid=0x54 runnable [0x00007f8d28ffd000]
   java.lang.Thread.State: RUNNABLE
	at java.net.PlainSocketImpl.socketAccept(Native Method)
	at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
	at java.net.ServerSocket.implAccept(ServerSocket.java:545)
	at java.net.ServerSocket.accept(ServerSocket.java:513)
	at com.orientechnologies.orient.server.network.OServerNetworkListener.run(OServerNetworkListener.java:188)

   Locked ownable synchronizers:
	- None

"OrientDB Write Cache Flush Task" #33 daemon prio=5 os_prio=0 tid=0x00007f8a9fff4800 nid=0x53 runnable [0x00007f8d309c5000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000000800159f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
	- None

"OrientDB WAL Write Task Thread)" #32 daemon prio=5 os_prio=0 tid=0x00007f8590004000 nid=0x52 waiting on condition [0x00007f8d30ac6000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000080024468> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
	- None

"OrientDB WAL Flush Task" #31 daemon prio=5 os_prio=0 tid=0x00007f8ad3ff4800 nid=0x51 runnable [0x00007f8d30bc7000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000080028800> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
	- None

"Thread-5" #30 daemon prio=5 os_prio=0 tid=0x00007f8b43ff4800 nid=0x50 waiting on condition [0x00007f8d310d5000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000008002cd00> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
	- None

"Timer-0" #26 daemon prio=5 os_prio=0 tid=0x00007f8cb049e800 nid=0x4d in Object.wait() [0x00007f8d32073000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.util.TimerThread.mainLoop(Timer.java:552)
	- locked <0x000000008001d7e8> (a java.util.TaskQueue)
	at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
	- None

"Thread-0" #24 prio=5 os_prio=0 tid=0x00007f8dec1bb000 nid=0x4c waiting on condition [0x00007f8d325c9000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000008001d9c0> (a java.util.concurrent.CountDownLatch$Sync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
	at com.orientechnologies.orient.server.OServer.waitForShutdown(OServer.java:620)
	at com.orientechnologies.orient.server.OServerMain$1.run(OServerMain.java:49)

   Locked ownable synchronizers:
	- None

"Service Thread" #23 daemon prio=9 os_prio=0 tid=0x00007f8dec12d000 nid=0x4a runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C1 CompilerThread17" #22 daemon prio=9 os_prio=0 tid=0x00007f8dec12a000 nid=0x49 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C1 CompilerThread16" #21 daemon prio=9 os_prio=0 tid=0x00007f8dec128000 nid=0x48 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C1 CompilerThread15" #20 daemon prio=9 os_prio=0 tid=0x00007f8dec126000 nid=0x47 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C1 CompilerThread14" #19 daemon prio=9 os_prio=0 tid=0x00007f8dec124800 nid=0x46 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C1 CompilerThread13" #18 daemon prio=9 os_prio=0 tid=0x00007f8dec122800 nid=0x45 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C1 CompilerThread12" #17 daemon prio=9 os_prio=0 tid=0x00007f8dec120800 nid=0x44 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread11" #16 daemon prio=9 os_prio=0 tid=0x00007f8dec11e800 nid=0x43 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread10" #15 daemon prio=9 os_prio=0 tid=0x00007f8dec11c800 nid=0x42 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread9" #14 daemon prio=9 os_prio=0 tid=0x00007f8dec11b000 nid=0x41 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread8" #13 daemon prio=9 os_prio=0 tid=0x00007f8dec119000 nid=0x40 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread7" #12 daemon prio=9 os_prio=0 tid=0x00007f8dec117000 nid=0x3f waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread6" #11 daemon prio=9 os_prio=0 tid=0x00007f8dec115000 nid=0x3e waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread5" #10 daemon prio=9 os_prio=0 tid=0x00007f8dec113000 nid=0x3d waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread4" #9 daemon prio=9 os_prio=0 tid=0x00007f8dec111800 nid=0x3c waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007f8dec10f800 nid=0x3b waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007f8dec10d800 nid=0x3a waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007f8dec10c000 nid=0x39 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007f8dec109000 nid=0x38 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007f8dec107800 nid=0x37 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
	- None

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f8dec0d6000 nid=0x36 in Object.wait() [0x00007f8d33bfa000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
	- locked <0x00000000800435c0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)

   Locked ownable synchronizers:
	- None

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f8dec0d3800 nid=0x35 in Object.wait() [0x00007f8d33cfb000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
	- locked <0x0000000080042ef0> (a java.lang.ref.Reference$Lock)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

   Locked ownable synchronizers:
	- None

"main" #1 prio=5 os_prio=0 tid=0x00007f8dec00d000 nid=0x8 in Object.wait() [0x00007f8df3436000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x000000008003bd28> (a com.orientechnologies.orient.server.OServerMain$1)
	at java.lang.Thread.join(Thread.java:1252)
	- locked <0x000000008003bd28> (a com.orientechnologies.orient.server.OServerMain$1)
	at java.lang.Thread.join(Thread.java:1326)
	at com.orientechnologies.orient.server.OServerMain.main(OServerMain.java:59)

   Locked ownable synchronizers:
	- None

"VM Thread" os_prio=0 tid=0x00007f8dec0ca000 nid=0x34 runnable 

"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007f8dec022800 nid=0x9 runnable 

"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007f8dec024800 nid=0xa runnable 

"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007f8dec026000 nid=0xb runnable 

"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007f8dec028000 nid=0xc runnable 

"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007f8dec029800 nid=0xd runnable 

"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007f8dec02b800 nid=0xe runnable 

"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007f8dec02d000 nid=0xf runnable 

"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007f8dec02f000 nid=0x10 runnable 

"GC task thread#8 (ParallelGC)" os_prio=0 tid=0x00007f8dec030800 nid=0x11 runnable 

"GC task thread#9 (ParallelGC)" os_prio=0 tid=0x00007f8dec032800 nid=0x12 runnable 

"GC task thread#10 (ParallelGC)" os_prio=0 tid=0x00007f8dec034000 nid=0x13 runnable 

"GC task thread#11 (ParallelGC)" os_prio=0 tid=0x00007f8dec036000 nid=0x14 runnable 

"GC task thread#12 (ParallelGC)" os_prio=0 tid=0x00007f8dec037800 nid=0x15 runnable 

"GC task thread#13 (ParallelGC)" os_prio=0 tid=0x00007f8dec039000 nid=0x16 runnable 

"GC task thread#14 (ParallelGC)" os_prio=0 tid=0x00007f8dec03b000 nid=0x17 runnable 

"GC task thread#15 (ParallelGC)" os_prio=0 tid=0x00007f8dec03c800 nid=0x18 runnable 

"GC task thread#16 (ParallelGC)" os_prio=0 tid=0x00007f8dec03e800 nid=0x19 runnable 

"GC task thread#17 (ParallelGC)" os_prio=0 tid=0x00007f8dec040000 nid=0x1a runnable 

"GC task thread#18 (ParallelGC)" os_prio=0 tid=0x00007f8dec042000 nid=0x1b runnable 

"GC task thread#19 (ParallelGC)" os_prio=0 tid=0x00007f8dec043800 nid=0x1c runnable 

"GC task thread#20 (ParallelGC)" os_prio=0 tid=0x00007f8dec045800 nid=0x1d runnable 

"GC task thread#21 (ParallelGC)" os_prio=0 tid=0x00007f8dec047000 nid=0x1e runnable 

"GC task thread#22 (ParallelGC)" os_prio=0 tid=0x00007f8dec049000 nid=0x1f runnable 

"GC task thread#23 (ParallelGC)" os_prio=0 tid=0x00007f8dec04a800 nid=0x20 runnable 

"GC task thread#24 (ParallelGC)" os_prio=0 tid=0x00007f8dec04c800 nid=0x21 runnable 

"GC task thread#25 (ParallelGC)" os_prio=0 tid=0x00007f8dec04e000 nid=0x22 runnable 

"GC task thread#26 (ParallelGC)" os_prio=0 tid=0x00007f8dec050000 nid=0x23 runnable 

"GC task thread#27 (ParallelGC)" os_prio=0 tid=0x00007f8dec051800 nid=0x24 runnable 

"GC task thread#28 (ParallelGC)" os_prio=0 tid=0x00007f8dec053800 nid=0x25 runnable 

"GC task thread#29 (ParallelGC)" os_prio=0 tid=0x00007f8dec055000 nid=0x26 runnable 

"GC task thread#30 (ParallelGC)" os_prio=0 tid=0x00007f8dec057000 nid=0x27 runnable 

"GC task thread#31 (ParallelGC)" os_prio=0 tid=0x00007f8dec058800 nid=0x28 runnable 

"GC task thread#32 (ParallelGC)" os_prio=0 tid=0x00007f8dec05a800 nid=0x29 runnable 

"GC task thread#33 (ParallelGC)" os_prio=0 tid=0x00007f8dec05c000 nid=0x2a runnable 

"GC task thread#34 (ParallelGC)" os_prio=0 tid=0x00007f8dec05e000 nid=0x2b runnable 

"GC task thread#35 (ParallelGC)" os_prio=0 tid=0x00007f8dec05f800 nid=0x2c runnable 

"GC task thread#36 (ParallelGC)" os_prio=0 tid=0x00007f8dec061800 nid=0x2d runnable 

"GC task thread#37 (ParallelGC)" os_prio=0 tid=0x00007f8dec063000 nid=0x2e runnable 

"GC task thread#38 (ParallelGC)" os_prio=0 tid=0x00007f8dec065000 nid=0x2f runnable 

"GC task thread#39 (ParallelGC)" os_prio=0 tid=0x00007f8dec066800 nid=0x30 runnable 

"GC task thread#40 (ParallelGC)" os_prio=0 tid=0x00007f8dec068800 nid=0x31 runnable 

"GC task thread#41 (ParallelGC)" os_prio=0 tid=0x00007f8dec06a000 nid=0x32 runnable 

"GC task thread#42 (ParallelGC)" os_prio=0 tid=0x00007f8dec06c000 nid=0x33 runnable 

"VM Periodic Task Thread" os_prio=0 tid=0x00007f8dec130000 nid=0x4b waiting on condition 

JNI global references: 1799
@wolf4ood
Copy link
Member

Hi @madmac2501

thanks for reporting this. Does this show the same/ more less stucked dump over time?

Or this eventually will be unlocked?

Thanks

@madmac2501
Copy link
Author

Hi,

In the past I get OrientDB stuck sometimes, but it's the first time that I get a thread dump.

Orientdb has been blocked for more than 30 minutes, I just restarted it.

Please let me know how can I help to get this fixed ASAP.

Thanks!

@andrii0lomakin
Copy link
Member

Hi @madmac2501 I am checking this issue

@andrii0lomakin
Copy link
Member

Well, I suppose that is deadlock let me check farther.

@andrii0lomakin
Copy link
Member

OK I have got the reason, will fix in 2 hours

@madmac2501
Copy link
Author

Thanks a lot!

@andrii0lomakin
Copy link
Member

Fixed, can you build it from repository ?

@andrii0lomakin
Copy link
Member

Sorry @madmac2501 I suppose I need to fix code in a few more places

@madmac2501
Copy link
Author

I just built and deployed it. I will let you know how the testing goes.

@andrii0lomakin
Copy link
Member

@madmac2501 you will have the same result, I found one place which is not covered by the fix. Do not waste your time I will provide an updated version at the midday of Friday.

andrii0lomakin added a commit that referenced this issue Feb 28, 2020
@andrii0lomakin
Issue #9156 has been fixed.
4bfa857
@andrii0lomakin
Copy link
Member

Hi, @madmac2501 should be fixed as for now. Could you check?

@madmac2501
Copy link
Author

Yes, I will build and test it. I don't know how I reproduced it, so even if it doesn't fail for me I don't know if other people will be affected.

BTW, I have some other tickets reported in github, could you take a look at them?

Thanks a lot!

@ygyg70
Copy link

ygyg70 commented Mar 2, 2020

Any update on this issue?
Seems that I hit it as well - seems like a regression
Does someone know what is the latest release that doesn't have this issue?

@madmac2501
Copy link
Author

I've been inserting non stop for 3 days with the latest 3.0.29-snapshot version and I've not reproduced the problem.

From my side this ticket can be closed. I'll open a new one if I hit it again.

Thanks a lot!

@madmac2501 madmac2501 mentioned this issue Mar 31, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@andrii0lomakin andrii0lomakin

Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@wolf4ood @andrii0lomakin @madmac2501 @ygyg70