[lttng-dev] Support for large files

[lttng-dev] Support for large files

[Oestman, Fredrik]

Hi,

We've run into a problem when attempting to produce large traces on a 32-bit machine. 

This is the console output:

Session met-2012-06-15_16-09-25 created.
Traces will be written in /home/nasir/lttng-traces/met-2012-06-15_16-09-25-20120615-160925
UST channel met_tools enabled for session met-2012-06-15_16-09-25
UST event met_func:* created in channel met_tools
UST event met_call:* created in channel met_tools
Tracing started for session met-2012-06-15_16-09-25
Ackermann: Jun 15 2012 16:01:06
Error: Error writing to tracefile
Tracing stopped for session met-2012-06-15_16-09-25
Session met-2012-06-15_16-09-25 destroyed

This is the trace directory (from another, identical run):

-rwxrwxrwx 1 nasir nasir       4096 2012-06-18 18:38 metadata*
-rwxrwxrwx 1 nasir nasir          0 2012-06-18 18:38 met_tools_0*
-rwxrwxrwx 1 nasir nasir          0 2012-06-18 18:38 met_tools_1*
-rwxrwxrwx 1 nasir nasir 2147483647 2012-06-18 18:40 met_tools_2*
-rwxrwxrwx 1 nasir nasir          0 2012-06-18 18:38 met_tools_3*

That the application runs on one core only is expected. The file size is 2 GiB - 1, which
is the limit for 32-bit file offset variables.

On 64-bit machines, the problem doesn't occur.

Is this problem known?

We are using lttng-ust 2.0.1 and userspace-rcu 0.6.7.


Cheers,

Fredrik ?stman

[lttng-dev] Support for large files

[Mathieu Desnoyers]

* Oestman, Fredrik (Fredrik_Oestman at mentor.com) wrote:
> Hi,
> 
> We've run into a problem when attempting to produce large traces on a 32-bit machine. 
> 
> This is the console output:
> 
> Session met-2012-06-15_16-09-25 created.
> Traces will be written in /home/nasir/lttng-traces/met-2012-06-15_16-09-25-20120615-160925
> UST channel met_tools enabled for session met-2012-06-15_16-09-25
> UST event met_func:* created in channel met_tools
> UST event met_call:* created in channel met_tools
> Tracing started for session met-2012-06-15_16-09-25
> Ackermann: Jun 15 2012 16:01:06
> Error: Error writing to tracefile
> Tracing stopped for session met-2012-06-15_16-09-25
> Session met-2012-06-15_16-09-25 destroyed
> 
> This is the trace directory (from another, identical run):
> 
> -rwxrwxrwx 1 nasir nasir       4096 2012-06-18 18:38 metadata*
> -rwxrwxrwx 1 nasir nasir          0 2012-06-18 18:38 met_tools_0*
> -rwxrwxrwx 1 nasir nasir          0 2012-06-18 18:38 met_tools_1*
> -rwxrwxrwx 1 nasir nasir 2147483647 2012-06-18 18:40 met_tools_2*
> -rwxrwxrwx 1 nasir nasir          0 2012-06-18 18:38 met_tools_3*
> 
> That the application runs on one core only is expected. The file size is 2 GiB - 1, which
> is the limit for 32-bit file offset variables.
> 
> On 64-bit machines, the problem doesn't occur.
> 
> Is this problem known?

Good catch. I guess we did not test enough on 32-bit. It's fixed on the
lttng-tools master branch by commit:

commit c72b7d965eb65a9f49a5615cac731cec3082aa7f
Author: Mathieu Desnoyers <mathieu.desnoyers at efficios.com>
Date:   Fri Jun 29 12:40:30 2012 +0200

    Fix: support large files on 32-bit systems
    
    Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers at efficios.com>

it should make its way into stable-2.0 branch soon.

By the way, babeltrace has the same issue, but we need to switch from
fts.h back to ftw.h to fix that, since fts.h does not support LFS.

Thanks,

Mathieu

> 
> We are using lttng-ust 2.0.1 and userspace-rcu 0.6.7.
> 
> 
> Cheers,
> 
> Fredrik ?stman
> 
> 
> _______________________________________________
> lttng-dev mailing list
> lttng-dev at lists.lttng.org
> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

-- 
Mathieu Desnoyers
Operating System Efficiency R&D Consultant
EfficiOS Inc.
http://www.efficios.com