[lttng-dev] LTTng project development activities November 2013

[lttng-dev] LTTng project development activities November 2013

[Christian Babeux]

Hi lttng-aficionados,

My apologies for the missing October summary, the previous months have
been pretty intense!

tl;dr : A lot of talks at LinuxCon/CloudOpen/Tracing Summit/ELCE on
LTTng; On track for mid-november 2.4 release candidate with live
streaming, Java JUL and health check in relayd/consumerd;

September 2013 summary:

- Minor releases:

lttng-modules 2.3.2, 2.3.1 and 2.2.2:

A timekeeping regression was introduced in the Linux kernel version
3.10.13 to 3.11.2 which could lead to hard system lockup when enabling
the tracing of some subsystems, including but not limited to
workqueues. The fix for this issue was merged in kernel 3.10.14 and
3.11.3+.

- Patches for the live streaming support have been merged in lttng-tools.

October 2013 summary:

- Patches for Java Util Logging (JUL) support have been merged in lttng-tools.

- Patches for CTF writer have been merged in Babeltrace. This new API
allow programmatic creation of CTF traces.

- Health check overhaul patches have been merged in lttng-tools. It is
now possible to query to health status of the consumer daemon and the
relay daemon.

Conferences activities:

* Google Summer of Code Mentor Summit 2013:

- J?r?mie Galarneau and Christian Babeux went to the GSoC Mentor
Summit to represent the LTTng project.

* LinuxCon Europe 2013:

- David Goulet gave a talk entitled "LTTng as a new monitoring tool" [1].

* CloudOpen Europe 2013:

- Julien Desfossez gave a talk entitled "Efficient and Large-scale
Infrastructure Monitoring with Tracing" [2].

* Tracing Summit 2013:

- Alexandre Montplaisir gave a talk entitled "Analyzing all kinds of
traces with TMF" [3]

- Mathieu Desnoyers gave a talk entitled "LTTng: Cloud Monitoring and
Distribution Bug Reporting with Live Streaming and Snapshots" [4]

* Embedded Linux Conference Europe 2013:

- Christian Babeux gave a talk entitled "Bridging the gap between
hardware and software tracing" [5]

On-going work:

We are on track for a mid-november 2.4 release candidate including the
live streaming, Java JUL logging support and health check in the
consumerd/relayd.

Thanks,

Christian

[1] - https://events.linuxfoundation.org/sites/events/files/slides/slides_2.pdf
[2] - https://events.linuxfoundation.org/sites/events/files/slides/presentation-cloudopen.pdf
[3] - http://www.tracingsummit.org/w/images/2/2a/TMF_AMG_TracingSummit2013.pdf
[4] - http://www.tracingsummit.org/w/images/b/b3/Lttng-desnoyers-tracing-summit-2013.pdf
[5] - http://www.slideshare.net/ChristianBabeux/slides-27979925

[lttng-dev] LTTng project development activities November 2013

[Alexandre Montplaisir]

Thanks for the update Christian!

Allow me to give a small update on the TMF (Tracing and Monitoring
Framework, a.k.a. Eclipse trace viewer) front, most of which I did talk
about in my presentation at LinuxCon.


Recent features merged in git:
- Stand-alone RCP version!
  This means it's now possible to download an architecture-dependant
build of the application that does not depend on Eclipse at all (only
needs a Java runtime). Users only interested in viewing traces, and not
in the whole Eclipse IDE integration, will probably prefer this version.
 
  Builds are available at http://lttng.org/eclipse, and are updated
semi-regularly.

- Callstack View support for UST traces
  Any UST trace taken with liblttng-ust-cyg-profile events will now
populate the Callstack View. This means you can now get the full
callstack for any application for which you have the source code!
 
  Screenshot:
  http://secretaire.dorsal.polymtl.ca/~alexmont/pics/callstackview.png
  (The binary with debugging symbols is required to get the function names.)

- Trace synchronization infrastructure
  The infrastructure is now in place to implement trace synchronization.
For example, synchronizing kernel traces from different machines, or for
synchronizing host+VM traces. Thanks to Benjamin Poirier, Masoume
Jabbarifar and Genevi?ve Bastien for their work on this feature!

- Index on disk
  The viewer's index is now saved to disk, instead of being kept in
memory. This means reopening an already-indexed trace should now be much
faster.


A taste of things to come:
http://secretaire.dorsal.polymtl.ca/~alexmont/pics/TMF-teaser-oct-2013.png

- CPU usage view, based on kernel events
- Memory allocation graph, using malloc events from
liblttng-ust-libc-wrapper
- Support for dynamically-loaded libraries in the UST Callstack. With
function names all the way down!

[lttng-dev] LTTng project development activities November 2013

[Mathieu Desnoyers]

----- Original Message -----
> From: "Christian Babeux" <christian.babeux@efficios.com>
> To: lttng-dev at lists.lttng.org
> Sent: Wednesday, November 6, 2013 5:19:45 PM
> Subject: [lttng-dev] LTTng project development activities November 2013
> 
> Hi lttng-aficionados,
> 
> My apologies for the missing October summary, the previous months have
> been pretty intense!
> 
> tl;dr : A lot of talks at LinuxCon/CloudOpen/Tracing Summit/ELCE on
> LTTng; On track for mid-november 2.4 release candidate with live
> streaming, Java JUL and health check in relayd/consumerd;
> 
> September 2013 summary:
> 
> - Minor releases:
> 
> lttng-modules 2.3.2, 2.3.1 and 2.2.2:
> 
> A timekeeping regression was introduced in the Linux kernel version
> 3.10.13 to 3.11.2 which could lead to hard system lockup when enabling
> the tracing of some subsystems, including but not limited to
> workqueues. The fix for this issue was merged in kernel 3.10.14 and
> 3.11.3+.

Small precision: the Linux kernel regression has been introduced in 3.10. It has been fixed in 3.10.14, 3.11.3, and 3.12 (and better).

LTTng modules has a blacklist that refuses to compile against the bad kernel versions.

Thanks,

Mathieu

> 
> - Patches for the live streaming support have been merged in lttng-tools.
> 
> October 2013 summary:
> 
> - Patches for Java Util Logging (JUL) support have been merged in
> lttng-tools.
> 
> - Patches for CTF writer have been merged in Babeltrace. This new API
> allow programmatic creation of CTF traces.
> 
> - Health check overhaul patches have been merged in lttng-tools. It is
> now possible to query to health status of the consumer daemon and the
> relay daemon.
> 
> Conferences activities:
> 
> * Google Summer of Code Mentor Summit 2013:
> 
> - J?r?mie Galarneau and Christian Babeux went to the GSoC Mentor
> Summit to represent the LTTng project.
> 
> * LinuxCon Europe 2013:
> 
> - David Goulet gave a talk entitled "LTTng as a new monitoring tool" [1].
> 
> * CloudOpen Europe 2013:
> 
> - Julien Desfossez gave a talk entitled "Efficient and Large-scale
> Infrastructure Monitoring with Tracing" [2].
> 
> * Tracing Summit 2013:
> 
> - Alexandre Montplaisir gave a talk entitled "Analyzing all kinds of
> traces with TMF" [3]
> 
> - Mathieu Desnoyers gave a talk entitled "LTTng: Cloud Monitoring and
> Distribution Bug Reporting with Live Streaming and Snapshots" [4]
> 
> * Embedded Linux Conference Europe 2013:
> 
> - Christian Babeux gave a talk entitled "Bridging the gap between
> hardware and software tracing" [5]
> 
> On-going work:
> 
> We are on track for a mid-november 2.4 release candidate including the
> live streaming, Java JUL logging support and health check in the
> consumerd/relayd.
> 
> Thanks,
> 
> Christian
> 
> [1] -
> https://events.linuxfoundation.org/sites/events/files/slides/slides_2.pdf
> [2] -
> https://events.linuxfoundation.org/sites/events/files/slides/presentation-cloudopen.pdf
> [3] -
> http://www.tracingsummit.org/w/images/2/2a/TMF_AMG_TracingSummit2013.pdf
> [4] -
> http://www.tracingsummit.org/w/images/b/b3/Lttng-desnoyers-tracing-summit-2013.pdf
> [5] - http://www.slideshare.net/ChristianBabeux/slides-27979925
> 
> _______________________________________________
> lttng-dev mailing list
> lttng-dev at lists.lttng.org
> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
> 

-- 
Mathieu Desnoyers
EfficiOS Inc.
http://www.efficios.com