HBase Forum

hbase responseTooLarge caused RpcServer Exception

  • #57094
    Roger Xu
    Participant

    version:HDP 2.1, Hbase 0.98
    Table’s cell having a large number of versions, it works fine when I read 100K VERSIONS from the cell, but it gives me exception when I attempted to read unto 1M VERSIONS. error happens with both hbase shell , and happy base client

    2014-07-10 10:45:30,098 WARN [RpcServer.handler=47,port=60020] ipc.RpcServer: (responseTooLarge): {“processingtimems”:104,”call”:”Get(org.apache.hadoop.hbase.protobuf.generated.ClientProtos$GetRequest)”,”client”:”17.203.54.172:56290″,”starttimems”:1405014329979,”queuetimems”:0,”class”:”HRegionServer”,”responsesize”:157334052,”method”:”Get”}
    2014-07-10 10:45:30,923 INFO [RpcServer.reader=6,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
    java.io.IOException: Connection reset by peer
    at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
    at sun.nio.ch.IOUtil.read(IOUtil.java:197)
    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
    at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2224)
    at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1415)
    at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:790)
    at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:581)
    at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:744)
    2014-07-10 10:45:30,923 WARN [RpcServer.responder] ipc.RpcServer: RpcServer.respondercallId: 93 service: ClientService methodName: Get size: 225 connection: 17.203.54.172:56290: output error
    2014-07-10 10:45:30,924 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: asyncWrite
    java.io.IOException: Broken pipe
    at sun.nio.ch.FileDispatcherImpl.writev0(Native Method)
    at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51)
    at sun.nio.ch.IOUtil.write(IOUtil.java:148)
    at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:524)
    at org.apache.hadoop.hbase.ipc.BufferChain.write(BufferChain.java:106)
    at org.apache.hadoop.hbase.ipc.RpcServer.channelWrite(RpcServer.java:2204)
    at org.apache.hadoop.hbase.ipc.RpcServer$Responder.processResponse(RpcServer.java:1004)
    at org.apache.hadoop.hbase.ipc.RpcServer$Responder.doAsyncWrite(RpcServer.java:944)
    at org.apache.hadoop.hbase.ipc.RpcServer$Responder.doRunLoop(RpcServer.java:873)
    at org.apache.hadoop.hbase.ipc.RpcServer$Responder.run(RpcServer.java:849)

to create new topics or reply. | New User Registration

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.