From patchwork Wed Mar 27 16:03:20 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yordan Karadzhov X-Patchwork-Id: 10873733 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 5B9F6922 for ; Wed, 27 Mar 2019 16:03:53 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 47E8C28759 for ; Wed, 27 Mar 2019 16:03:53 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 3C91C287C8; Wed, 27 Mar 2019 16:03:53 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id B7B66287C2 for ; Wed, 27 Mar 2019 16:03:52 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726990AbfC0QDw (ORCPT ); Wed, 27 Mar 2019 12:03:52 -0400 Received: from mail-pf1-f193.google.com ([209.85.210.193]:34614 "EHLO mail-pf1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727469AbfC0QDw (ORCPT ); Wed, 27 Mar 2019 12:03:52 -0400 Received: by mail-pf1-f193.google.com with SMTP id b3so8550253pfd.1 for ; Wed, 27 Mar 2019 09:03:51 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=Hs6abDd+R5XRjHVJGRT3Zm2JeiFasU70eNA248oAoTA=; b=iyMCb2G1JnMnYeIYzdzFYf5RUUeKRVBpkeM95fqQMapkeAZ9oBlP9H+TEdWObwk3Cq 3D/KPyj5IkKXU1OH53dak1A5vNmcNjRCfjZRkiAUVTS9OooiFEmy6/TixOXHyiJahL6h 4Mca5Lur8UYZ3nZcoZ06I4dbc+pYhZXyeyCeVDdzchcKCheD6QOiPsc2f5NBPAHmsS/Z +/kuR76VcEdGM9TCQ3Cew0Uz9FgI6O+YFWMV3vN2ZnxQF7yue8niz4yEj34sT8z1fsfT ue+b12cauE4pP/OoA6VRfNdD4BNr+ORpfIT1olcaV1zzHjiRA/ekHo5sTEWECKt8soz6 fFXQ== X-Gm-Message-State: APjAAAUe55rElLvTRE7VIprWzYzgnpw3QW2aajf4O3zU9IsyPCLAWQb7 IRR7cOl+kqULTn8ZeYtUUtc= X-Google-Smtp-Source: APXvYqx/gAu2Z8EOUCl++y5PIP8GWyKuZj8PL71vJ1+lDGQp2jgXPxyQ6v84fVcG2rex49xCYGYPBw== X-Received: by 2002:aa7:8453:: with SMTP id r19mr8736500pfn.44.1553702631252; Wed, 27 Mar 2019 09:03:51 -0700 (PDT) Received: from mamba.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id p88sm36150806pfa.80.2019.03.27.09.03.49 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 27 Mar 2019 09:03:50 -0700 (PDT) From: Yordan Karadzhov To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org, y.karadz@gmail.com Subject: [RFC 4/7] kernel-shark: Add the core components of the NumPy API Date: Wed, 27 Mar 2019 18:03:20 +0200 Message-Id: <20190327160323.31654-5-ykaradzhov@vmware.com> X-Mailer: git-send-email 2.19.1 In-Reply-To: <20190327160323.31654-1-ykaradzhov@vmware.com> References: <20190327160323.31654-1-ykaradzhov@vmware.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP The NumPy API is meant to operate on top of the C API-s of trace-cmd and KernelShark and to provide only the minimum of basic functionalities needed in order to processor the tracing data. The NumPy API itself is made of two layers. A bottom-one written in C and a top-one which implements the interface, written in Cython (C-Python). This patch introduces the C layer. Signed-off-by: Yordan Karadzhov --- kernel-shark/src/libkshark-py.c | 176 ++++++++++++++++++++++++++++++++ 1 file changed, 176 insertions(+) create mode 100644 kernel-shark/src/libkshark-py.c diff --git a/kernel-shark/src/libkshark-py.c b/kernel-shark/src/libkshark-py.c new file mode 100644 index 0000000..4c589f3 --- /dev/null +++ b/kernel-shark/src/libkshark-py.c @@ -0,0 +1,176 @@ +// SPDX-License-Identifier: LGPL-2.1 + +/* + * Copyright (C) 2019 VMware Inc, Yordan Karadzhov + */ + + /** + * @file libpykshark-py.c + * @brief Python API for processing of FTRACE (trace-cmd) data. + */ + +// KernelShark +#include "libkshark.h" +#include "libkshark-model.h" + +bool kspy_open(const char *fname) +{ + struct kshark_context *kshark_ctx = NULL; + + if (!kshark_instance(&kshark_ctx)) + return false; + + return kshark_open(kshark_ctx, fname); +} + +void kspy_close(void) +{ + struct kshark_context *kshark_ctx = NULL; + + if (!kshark_instance(&kshark_ctx)) + return; + + kshark_close(kshark_ctx); + kshark_free(kshark_ctx); +} + +static int compare(const void * a, const void * b) +{ + return ( *(int*)a - *(int*)b ); +} + +size_t kspy_get_tasks(int **pids, char ***names) +{ + struct kshark_context *kshark_ctx = NULL; + const char *comm; + ssize_t i, n; + int ret; + + if (!kshark_instance(&kshark_ctx)) + return 0; + + n = kshark_get_task_pids(kshark_ctx, pids); + if (n == 0) + return 0; + + qsort(*pids, n, sizeof(**pids), compare); + + *names = calloc(n, sizeof(char*)); + if (!(*names)) + goto fail; + + for (i = 0; i < n; ++i) { + comm = tep_data_comm_from_pid(kshark_ctx->pevent, (*pids)[i]); + ret = asprintf(&(*names)[i], "%s", comm); + if (ret < 1) + goto fail; + } + + return n; + + fail: + free(*pids); + free(*names); + return 0; +} + +size_t kspy_trace2matrix(uint64_t **offset_array, + uint8_t **cpu_array, + uint64_t **ts_array, + uint16_t **pid_array, + int **event_array) +{ + struct kshark_context *kshark_ctx = NULL; + size_t total = 0; + + if (!kshark_instance(&kshark_ctx)) + return false; + + total = kshark_load_data_matrix(kshark_ctx, offset_array, + cpu_array, + ts_array, + pid_array, + event_array); + + return total; +} + +int kspy_get_event_id(const char *sys, const char *evt) +{ + struct kshark_context *kshark_ctx = NULL; + struct tep_event *event; + + if (!kshark_instance(&kshark_ctx)) + return -1; + + event = tep_find_event_by_name(kshark_ctx->pevent, sys, evt); + + return event->id; +} + +uint64_t kspy_read_event_field(uint64_t offset, const char *sys, + const char *evt, + const char *field) +{ + struct kshark_context *kshark_ctx = NULL; + struct tep_format_field *evt_field; + struct tep_record *record; + struct tep_event *event; + unsigned long long val; + int ret; + + if (!kshark_instance(&kshark_ctx)) + return 0; + + event = tep_find_event_by_name(kshark_ctx->pevent, sys, evt); + if (!event) + return 0; + + evt_field = tep_find_any_field(event, field); + if (!evt_field) + return 0; + + record = tracecmd_read_at(kshark_ctx->handle, offset, NULL); + if (!record) + return 0; + + ret = tep_read_number_field(evt_field, record->data, &val); + free_record(record); + + if (ret != 0) + return 0; + + return val; +} + +void kspy_new_session_file(const char *data_file, const char *session_file) +{ + struct kshark_context *kshark_ctx = NULL; + struct kshark_trace_histo histo; + struct kshark_config_doc *session; + struct kshark_config_doc *filters; + struct kshark_config_doc *markers; + struct kshark_config_doc *model; + struct kshark_config_doc *file; + + if (!kshark_instance(&kshark_ctx)) + return; + + session = kshark_config_new("kshark.config.session", + KS_CONFIG_JSON); + + file = kshark_export_trace_file(data_file, KS_CONFIG_JSON); + kshark_config_doc_add(session, "Data", file); + + filters = kshark_export_all_filters(kshark_ctx, KS_CONFIG_JSON); + kshark_config_doc_add(session, "Filters", filters); + + ksmodel_init(&histo); + model = kshark_export_model(&histo, KS_CONFIG_JSON); + kshark_config_doc_add(session, "Model", model); + + markers = kshark_config_new("kshark.config.markers", KS_CONFIG_JSON); + kshark_config_doc_add(session, "Markers", markers); + + kshark_save_config_file(session_file, session); +}