InterruptedException during put operation SSM Xmemcached

300 Views Asked by At

We have a dedicated server as memcached. It has below configuration:

STAT curr_connections 242
STAT total_connections 684
STAT chunk_size 48
STAT num_threads 64
STAT num_threads_per_udp 64

But we are seeing InterruptedException exception for a cache during object setting. below are the logs

WARN  [com.google.code.ssm.spring.SSMCache] (hystrix-ABCGROUP-45)  An error has ocurred for cache APP_CACHE_1 and key 51BREAnullUFLDE384nullHOnull: com.google.code.ssm.providers.CacheException: java.lang.InterruptedException
        at com.google.code.ssm.providers.xmemcached.MemcacheClientWrapper.set(MemcacheClientWrapper.java:240)
        at com.google.code.ssm.CacheImpl.set(CacheImpl.java:290)
        at com.google.code.ssm.CacheImpl.set(CacheImpl.java:128)
        at com.google.code.ssm.spring.SSMCache.put(SSMCache.java:109)
        at org.springframework.cache.interceptor.AbstractCacheInvoker.doPut(AbstractCacheInvoker.java:82)
        at org.springframework.cache.interceptor.CacheAspectSupport$CachePutRequest.apply(CacheAspectSupport.java:651)
        at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:358)
        at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:299)
        at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:207)
        at com.sun.proxy.$Proxy140.cleanseAddress(Unknown Source)
        at org.hystrix.command.ABCommand.runTask(ABCommand.java:33)
        at org.hystrix.command.ABCommand.runTask(ABCommand.java:13)
        at org.hystrix.BaseHystrixCommand.run(BaseHystrixCommand.java:75)
        at com.netflix.hystrix.HystrixCommand$1.call(HystrixCommand.java:293)
        at com.netflix.hystrix.HystrixCommand$1.call(HystrixCommand.java:288)
        at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:50)
        at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:30)
        at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:50)
        at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:30)
        at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:50)
        at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:30)
        at rx.Observable.unsafeSubscribe(Observable.java:8460)
        at com.netflix.hystrix.AbstractCommand$5.call(AbstractCommand.java:521)
        at com.netflix.hystrix.AbstractCommand$5.call(AbstractCommand.java:497)
        at rx.Observable.unsafeSubscribe(Observable.java:8460)
        at rx.internal.operators.OperatorSubscribeOn$1.call(OperatorSubscribeOn.java:94)
        at com.netflix.hystrix.strategy.concurrency.HystrixContexSchedulerAction$1.call(HystrixContexSchedulerAction.java:56)
        at org.util.ContextCallable.call(ContextCallable.java:51)
        at com.netflix.hystrix.strategy.concurrency.HystrixContexSchedulerAction.call(HystrixContexSchedulerAction.java:69)
        at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_92]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_92]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_92]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_92]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_92]
Caused by: java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326) [rt.jar:1.8.0_92]
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) [rt.jar:1.8.0_92]
        at net.rubyeye.xmemcached.XMemcachedClient.latchWait(XMemcachedClient.java:2516)
        at net.rubyeye.xmemcached.XMemcachedClient.sendStoreCommand(XMemcachedClient.java:2498)
        at net.rubyeye.xmemcached.XMemcachedClient.set(XMemcachedClient.java:1338)
        at net.rubyeye.xmemcached.XMemcachedClient.set(XMemcachedClient.java:1396)
        at net.rubyeye.xmemcached.XMemcachedClient.set(XMemcachedClient.java:1383)
        at com.google.code.ssm.providers.xmemcached.MemcacheClientWrapper.set(MemcacheClientWrapper.java:238)
        ... 39 more

Below is the memcached version

<dependency>
     <groupId>com.googlecode.xmemcached</groupId>
    <artifactId>xmemcached</artifactId>
    <version>2.0.0</version>
</dependency>
<dependency>
    <groupId>com.google.code.simple-spring-memcached</groupId>
    <artifactId>xmemcached-provider</artifactId>
    <version>3.6.0</version>
</dependency>
<dependency>
 <groupId>com.google.code.simple-spring-memcached</groupId> 
 <artifactId>spring-cache</artifactId>
  <version>3.1.0</version> 
</dependency>

I am not sure what can be the reason for this exception. We have multiple caches configured but this exception is encountered only for APP_CACHE_1. The expiration of APP_CACHE_1 is 7200.

1

There are 1 best solutions below

0
On

Try newer version of xmemcached: 2.2.0, in older version there was a similar bug: https://github.com/killme2008/xmemcached/issues/30

I haven't tested if it's compatible with SSM 3.6.0 but it's worth to try.

Use the newest version of xmemcached-provider and spring-cache: 3.6.1