Negotiation

NEGOTIATIONS
Vocabulary

 (e.g. means "for example")

  Agent

  Person or company that acts for another and provides a specified
  service

  Agreement

  Arrangement between two or more people or companies

  Bargain price

  Reduced price

  Bedrock price

  lowest possible price

  Commitment

  Engagement or undertaking;  to commit oneself

  Condition

  A stipulation or requirement which must be fulfilled

  Contract

  Written agreement between two or more parties

  Counter-offer

  Offer made in response to an offer by the other party

  Counter-productive

  Having the opposite effect to that intended

  Deal

  A business transaction

  Discount

  Reduction in price

  Estimate

  Approximate calculation of the cost

  Facilities

  Equipment (e.g. parking facilities)

  Feasible

  Possible, something that can be done

  Figure out

  Find a solution;  estimate the cost

  Know-how

  Practical knowledge or skill

  Joint Venture

  A way of entering a foreign market by joining with a foreign company
  to manufacture or market a product or service.

  Negotiate

  Discuss a business deal or contract in order to reach an agreement

  Point out

  Draw attention to something (e.g. the advantages of your proposal)

  Proposal

  Course of action, or plan, put forward for consideration;
  to make a proposal

  Quote

  Give an estimated price (a quotation)

  Range

  A selection of products sold by a company

  Rebate

  Reduction or discount

  Supply

  Provide customers with goods or services

  Supplier

  Person or company that supplies goods or services

  Tender

  An offer, in writing, to execute work or supply goods at a fixed price

  Turnkey

  Describes equipment ready for use or operation
  (e.g. plant or factory)

  Underestimate

  Make too low an estimate of something (cost, danger, difficulty)

  Work out

  Calculate (e.g. the price of something);  find a solution

下午2点22:24.313分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:24.313393 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28325 0703 14:22:24.313468 (+ 75us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:24.313470 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:24.313500 (+ 30us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28325: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":52,"thread_start_us":31,"threads_started":1} 下午2点22:26.315分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:26.314870 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28335 0703 14:22:26.314984 (+ 114us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:26.314986 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:26.315020 (+ 34us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28335: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":48,"threads_started":1} 下午2点22:29.316分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:29.316617 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28369 0703 14:22:29.316720 (+ 103us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:29.316722 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:29.316777 (+ 55us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28369: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":70,"thread_start_us":33,"threads_started":1} 下午2点22:38.321分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:38.321291 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28477 0703 14:22:38.321407 (+ 116us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:38.321408 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:38.321455 (+ 47us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28477: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":44,"threads_started":1} 下午2点22:39.322分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:39.321925 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28481 0703 14:22:39.322026 (+ 101us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:39.322028 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:39.322065 (+ 37us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28481: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":33,"threads_started":1} 下午2点22:41.323分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:41.323074 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28539 0703 14:22:41.323210 (+ 136us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:41.323212 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:41.323255 (+ 43us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28539: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":32,"threads_started":1} 下午2点22:42.323分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:42.323577 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28543 0703 14:22:42.323678 (+ 101us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:42.323679 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:42.323714 (+ 35us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28543: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":46,"threads_started":1} 下午2点22:43.324分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:43.324118 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28547 0703 14:22:43.324201 (+ 83us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:43.324202 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:43.324238 (+ 36us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28547: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":58,"thread_start_us":31,"threads_started":1} 下午2点22:46.325分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:46.325779 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28561 0703 14:22:46.325863 (+ 84us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:46.325864 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:46.325907 (+ 43us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28561: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":59,"thread_start_us":32,"threads_started":1} 下午2点22:49.327分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:49.327317 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28585 0703 14:22:49.327399 (+ 82us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:49.327400 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:49.327435 (+ 35us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28585: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":58,"thread_start_us":31,"threads_started":1} 下午2点22:51.328分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:51.328298 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28655 0703 14:22:51.328377 (+ 79us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:51.328379 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:51.328415 (+ 36us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28655: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":57,"thread_start_us":29,"threads_started":1} 下午2点22:52.329分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:52.328845 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28663 0703 14:22:52.328933 (+ 88us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:52.328935 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:52.328969 (+ 34us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28663: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":62,"thread_start_us":34,"threads_started":1} 下午2点22:54.330分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:54.329913 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28671 0703 14:22:54.329996 (+ 83us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:54.329997 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:54.330031 (+ 34us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28671: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":58,"thread_start_us":29,"threads_started":1} 下午2点22:58.332分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:22:58.332297 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28697 0703 14:22:58.332370 (+ 73us) server_negotiation.cc:176] Beginning negotiation 0703 14:22:58.332372 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:22:58.332401 (+ 29us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28697: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":51,"thread_start_us":27,"threads_started":1} 下午2点23:02.334分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:02.334192 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28781 0703 14:23:02.334276 (+ 84us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:02.334277 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:02.334314 (+ 37us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28781: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":59,"thread_start_us":29,"threads_started":1} 下午2点23:06.336分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:06.336363 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28809 0703 14:23:06.336440 (+ 77us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:06.336442 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:06.336482 (+ 40us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28809: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":53,"thread_start_us":29,"threads_started":1} 下午2点23:07.337分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:07.336919 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28823 0703 14:23:07.337014 (+ 95us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:07.337016 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:07.337051 (+ 35us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28823: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":66,"thread_start_us":31,"threads_started":1} 下午2点23:08.337分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:08.337404 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28827 0703 14:23:08.337488 (+ 84us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:08.337489 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:08.337522 (+ 33us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28827: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":59,"thread_start_us":31,"threads_started":1} 下午2点23:09.338分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:09.338069 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28833 0703 14:23:09.338145 (+ 76us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:09.338147 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:09.338176 (+ 29us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28833: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":54,"thread_start_us":29,"threads_started":1} 下午2点23:10.338分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:10.338582 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28897 0703 14:23:10.338680 (+ 98us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:10.338681 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:10.338717 (+ 36us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28897: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":43,"threads_started":1} 下午2点23:11.339分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:11.339150 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28903 0703 14:23:11.339214 (+ 64us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:11.339216 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:11.339243 (+ 27us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28903: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":44,"thread_start_us":26,"threads_started":1} 下午2点23:12.344分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:12.342681 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28907 0703 14:23:12.344551 (+ 1870us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:12.344553 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:12.344608 (+ 55us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28907: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":1846,"thread_start_us":30,"threads_started":1} 下午2点23:14.340分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:14.340680 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28915 0703 14:23:14.340746 (+ 66us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:14.340748 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:14.340792 (+ 44us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28915: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":45,"thread_start_us":24,"threads_started":1} 下午2点23:16.342分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:16.341880 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28925 0703 14:23:16.341965 (+ 85us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:16.341967 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:16.342000 (+ 33us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28925: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":62,"thread_start_us":34,"threads_started":1} 下午2点23:19.343分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:19.343394 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:28937 0703 14:23:19.343463 (+ 69us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:19.343464 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:19.343492 (+ 28us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:28937: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":47,"thread_start_us":27,"threads_started":1} 下午2点23:22.345分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:22.344988 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29035 0703 14:23:22.345090 (+ 102us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:22.345091 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:22.345133 (+ 42us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29035: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":66,"thread_start_us":31,"threads_started":1} 下午2点23:27.347分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:27.347733 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29061 0703 14:23:27.347813 (+ 80us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:27.347815 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:27.347853 (+ 38us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29061: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":57,"thread_start_us":29,"threads_started":1} 下午2点23:28.348分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:28.348320 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29067 0703 14:23:28.348396 (+ 76us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:28.348398 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:28.348433 (+ 35us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29067: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":52,"thread_start_us":26,"threads_started":1} 下午2点23:29.348分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:29.348843 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29089 0703 14:23:29.348928 (+ 85us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:29.348929 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:29.348966 (+ 37us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29089: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":62,"thread_start_us":30,"threads_started":1} 下午2点23:33.351分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:33.350931 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29165 0703 14:23:33.351016 (+ 85us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:33.351017 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:33.351056 (+ 39us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29165: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":59,"thread_start_us":29,"threads_started":1} 下午2点23:34.351分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:34.351500 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29169 0703 14:23:34.351582 (+ 82us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:34.351583 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:34.351630 (+ 47us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29169: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":59,"thread_start_us":31,"threads_started":1} 下午2点23:35.352分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:35.352170 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29175 0703 14:23:35.352242 (+ 72us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:35.352244 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:35.352281 (+ 37us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29175: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":50,"thread_start_us":27,"threads_started":1} 下午2点23:36.352分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:36.352791 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29179 0703 14:23:36.352871 (+ 80us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:36.352872 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:36.352911 (+ 39us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29179: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":55,"thread_start_us":26,"threads_started":1} 下午2点23:37.353分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:37.353325 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29189 0703 14:23:37.353399 (+ 74us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:37.353401 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:37.353434 (+ 33us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29189: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":50,"thread_start_us":26,"threads_started":1} 下午2点23:38.354分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:38.353879 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29193 0703 14:23:38.353957 (+ 78us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:38.353958 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:38.353999 (+ 41us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29193: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":54,"thread_start_us":24,"threads_started":1} 下午2点23:39.354分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:39.354443 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29197 0703 14:23:39.354517 (+ 74us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:39.354518 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:39.354547 (+ 29us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29197: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":51,"thread_start_us":28,"threads_started":1} 下午2点23:40.355分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:40.354957 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29263 0703 14:23:40.355041 (+ 84us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:40.355042 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:40.355075 (+ 33us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29263: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":60,"thread_start_us":33,"threads_started":1} 下午2点23:41.355分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:41.355530 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29269 0703 14:23:41.355613 (+ 83us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:41.355614 (+ 1us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:41.355646 (+ 32us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29269: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":53,"thread_start_us":28,"threads_started":1} 下午2点23:42.356分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:42.356115 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29277 0703 14:23:42.356174 (+ 59us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:42.356176 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:42.356212 (+ 36us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29277: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":39,"thread_start_us":23,"threads_started":1} 下午2点23:44.357分 WARN cc:313 Failed RPC negotiation. Trace: 0703 14:23:44.357269 (+ 0us) reactor.cc:577] Submitting negotiation task for server connection from 10.109.133.28:29289 0703 14:23:44.357342 (+ 73us) server_negotiation.cc:176] Beginning negotiation 0703 14:23:44.357344 (+ 2us) server_negotiation.cc:365] Waiting for connection header 0703 14:23:44.357382 (+ 38us) negotiation.cc:304] Negotiation complete: Network error: Server connection negotiation failed: server connection from 10.109.133.28:29289: BlockingRecv error: Recv() got EOF from remote (error 108) Metrics: {"server-negotiator.queue_time_us":50,"thread_start_us":26,"threads_started":1}
07-04
从日志来看,Kudu Master节点持续出现RPC协商失败的问题,主要错误是"Recv() got EOF from remote (error 108)"。这种情况通常表明客户端在RPC协商过程中异常断开连接。以下是详细分析和建议: ### 问题分析 1. **错误特征**: - 持续不断的RPC协商失败(约每分钟1-2次) - 协商过程非常快速(通常在100微秒内完成) - 错误码108(连接对端关闭)和111(连接拒绝) 2. **可能原因**: - 客户端应用异常终止或崩溃 - 网络不稳定导致连接中断 - 防火墙/安全组拦截了RPC通信 - Kudu服务端资源不足(CPU/内存) - 客户端与服务器版本不兼容 ### 建议解决方案 1. **网络层面检查**: ```bash # 检查节点间网络连通性 ping 10.109.133.28 telnet 10.109.133.28 7051 # 检查防火墙规则 iptables -L -n | grep 7051 ``` 2. **Kudu服务检查**: ```bash # 检查master服务状态 sudo systemctl status kudu-master # 检查资源使用情况 top -p $(pgrep -f kudu-master) ``` 3. **配置调整**: ```bash # 增加RPC超时时间(在master的gflagfile中添加) --rpc_negotiation_timeout_ms=30000 --rpc_connection_timeout_ms=30000 ``` 4. **日志收集**: - 收集所有Kudu节点的完整日志 - 检查客户端应用程序的日志 5. **客户端检查**: - 确认客户端应用正确处理连接生命周期 - 检查客户端是否频繁创建/关闭连接 ### 监控建议 1. 设置监控告警针对: - RPC失败率 - 节点网络丢包率 - Master节点的CPU/内存使用率 2. 使用Kudu内置指标: ```bash curl http://<master>:8050/metrics | grep rpc ```
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值