From patchwork Fri Mar 4 17:14:13 2011 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jim Schutt X-Patchwork-Id: 609711 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by demeter1.kernel.org (8.14.4/8.14.3) with ESMTP id p24HER8K023224 for ; Fri, 4 Mar 2011 17:14:27 GMT Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1759883Ab1CDRO0 (ORCPT ); Fri, 4 Mar 2011 12:14:26 -0500 Received: from sentry-three.sandia.gov ([132.175.109.17]:39732 "EHLO sentry-three.sandia.gov" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1759768Ab1CDRO0 (ORCPT ); Fri, 4 Mar 2011 12:14:26 -0500 X-WSS-ID: 0LHJMJX-0C-BPB-02 X-M-MSG: Received: from sentry.sandia.gov (sentry.sandia.gov [132.175.109.21]) by sentry-three.sandia.gov (Postfix) with ESMTP id 1984B529423 for ; Fri, 4 Mar 2011 10:14:21 -0700 (MST) Received: from [134.253.103.2] by sentry.sandia.gov with ESMTP (SMTP Relay 01 (Email Firewall v6.3.2)); Fri, 04 Mar 2011 10:14:13 -0700 X-Server-Uuid: AF72F651-81B1-4134-BA8C-A8E1A4E620FF Received: from [134.253.4.20] (134.253.95.171) by mail.sandia.gov ( 134.253.103.2) with Microsoft SMTP Server (TLS) id 14.1.270.1; Fri, 4 Mar 2011 10:14:13 -0700 Subject: monitor dispatch queue seems backed up? From: "Jim Schutt" To: "ceph-devel@vger.kernel.org" Date: Fri, 4 Mar 2011 10:14:13 -0700 Message-ID: <1299258853.4750.191.camel@sale659.sandia.gov> MIME-Version: 1.0 X-Mailer: Evolution 2.12.3 (2.12.3-19.el5) X-Originating-IP: [134.253.95.171] X-TMWD-Spam-Summary: TS=20110304171416; ID=1; SEV=2.3.1; DFV=B2011030416; IFV=NA; AIF=B2011030416; RPD=5.03.0010; ENG=NA; RPDID=7374723D303030312E30413031303230392E34443731314445382E303130412C73733D312C6667733D30; CAT=NONE; CON=NONE; SIG=AAABAJsKIgAAAAAAAAAAAAAAAAAAAH0= X-MMS-Spam-Filter-ID: B2011030416_5.03.0010 X-WSS-ID: 616FC26F0YW4569000-01-01 Sender: ceph-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: ceph-devel@vger.kernel.org X-Greylist: IP, sender and recipient auto-whitelisted, not delayed by milter-greylist-4.2.6 (demeter1.kernel.org [140.211.167.41]); Fri, 04 Mar 2011 17:14:27 +0000 (UTC) diff --git a/src/msg/SimpleMessenger.cc b/src/msg/SimpleMessenger.cc index 23e6b29..96e74e9 100644 --- a/src/msg/SimpleMessenger.cc +++ b/src/msg/SimpleMessenger.cc @@ -352,17 +352,26 @@ void SimpleMessenger::dispatch_entry() << " " << m->get_footer().data_crc << ")" << " " << m << " con " << m->get_connection() << dendl; + utime_t recv_stamp = m->get_recv_stamp(); + utime_t disp_stamp = g_clock.now(); ms_deliver_dispatch(m); dispatch_throttle_release(msize); - dout(20) << "done calling dispatch on " << m << dendl; + utime_t done_stamp = g_clock.now(); + dout(20) << "dispatch_entry done with " << m + << " que_et " << disp_stamp - recv_stamp + << " op_et " << done_stamp - disp_stamp + << " tot_et " << done_stamp - recv_stamp << dendl; } } dispatch_queue.lock.Lock(); } - if (!dispatch_queue.stop) + if (!dispatch_queue.stop) { + dout(20) << " Waiting for new work on SimpleMessenger dispatch queue" << dendl; dispatch_queue.cond.Wait(dispatch_queue.lock); //wait for something to be put on queue + dout(20) << " Got new work on SimpleMessenger dispatch queue" << dendl; + } } dispatch_queue.lock.Unlock(); @@ -553,8 +562,10 @@ void SimpleMessenger::Pipe::queue_received(Message *m, int priority) dout(20) << "queue_received queuing pipe" << dendl; if (!queue_items.count(priority)) queue_items[priority] = new xlist::item(this); - if (messenger->dispatch_queue.queued_pipes.empty()) + if (messenger->dispatch_queue.queued_pipes.empty()) { + dout(20) << " Waking up SimpleMessenger dispatch queue" << dendl; messenger->dispatch_queue.cond.Signal(); + } messenger->dispatch_queue.queued_pipes[priority].push_back(queue_items[priority]); }