Hemang LavanaVince Darley$Revision: 1.11 $

This TIP proposes that the Tcl's trace command be extended to include the following features: 1. tracing of command execution for the specified tcl command, and 2. step-wise tracing of any command execution within a specified procedure.

One of the main strengths of Tcl is the ability to trace read, write or delete operations on variables. Moreover, Tcl8.4 has already added support for tracing rename or delete operations on Tcl commands. Addition of the proposed subcommand for tracing executions will further improve the capabilities of Tcl without any loss of performance (see Benchmark Results section below). I can see several applications of this feature, including: overloading/wrapping of Tcl commands, please see aid developer in debugging Tcl scripts profiler module in tcllib can benefit from this feature

This TIP proposes an enhancement to the trace command with the following syntax: ICAgICAgICB0cmFjZSBhZGQgZXhlY3V0aW9uIG5hbWUgb3BzIGNvbW1hbmQ= The type execution is used to arrange for command to be executed whenever the command name is invoked for execution. Name may refer to any of the tcl commands or procedures that have been previously defined. It is an error to create an execution trace on a non-existant command or a procedure. The ops argument can accept enter, leave, enterstep, and leavestep as valid operations: enter - Invoke command whenever the command name is executed, just before the actual execution takes place.leave - Invoke command whenever the command name is executed, just after the actual execution takes place.enterstep - Invoke command for every tcl command which is executed inside the procedure name, just before the actual execution takes place. Setting a enterstep trace on a command will not result in an error and is simply ignored.leavestep - Invoke command for every tcl command which is executed inside the procedure name, just after the actual execution takes place. Setting a leavestep trace on a command will not result in an error and is simply ignored. When the trace triggers, depending on the operations being traced, a number of arguments are appended to command so that the actual command is as follows: For enter and enterstep operations: ICAgIGNvbW1hbmQgY29tbWFuZC1zdHJpbmcgb3A= command-string gives the complete current command being executed, including all arguments in their fully expanded form. Op indicates what operation is being performed on the variable, and is one of enter or enterstep here. The trace operation can be used to stop the command from executing, by deleting the command in question. Of course when the command is subsequently executed, an 'invalid command' error will occur. For leave and leavestep operations: ICAgY29tbWFuZCBjb21tYW5kLXN0cmluZyBjb2RlIHJlc3VsdCBvcA== command-string gives the complete current command being executed, including all arguments in their fully expanded form. code gives the result code of that execution, and result gives its result string. Op indicates what operation is being performed on the variable, and is one of leave or leavestep here. Command executes in the same context as the code that invoked the traced operation: thus the command, if invoked from a procedure, will have access to the same local variables as code in the procedure. This context may be different than the context in which the trace was created. If command invokes a procedure (which it normally does) then the procedure will have to use upvar or uplevel commands if it wishes to access the local variables of the code which invoked the trace operation. Note that if the value of a local variable is passed as an argument to the traced command name and is modified by the command procedure, the traced command name will still be invoked with the old value of the local variable. This is because the argument list to name is formed before the traced command is invoked. Please see the section on Future Scope below on how to modify the arguments passed to name. While command is executing during an execution trace, traces on name are temporarily disabled. This allows the command to execute name in its body without invoking any other traces again. If an error occurs while executing the command body, then the command name as a whole will return that same error. Therefore, if catch command is used for invocation of the name command, it will also ignore errors resulting from such traces. When multiple traces are set on name, then the sequence of trace command invocation is as follows: For enter and enterstep operations, the traced commands are invoked in the reverse order of how these traces were created. For leave and leavestep operations, the traced commands are invoked in the same order as how these traces were created. For example, if we have two traces on proc foo: ICAgIHRyYWNlIGFkZCBleGVjdXRpb24gZm9vIHtlbnRlciBsZWF2ZX0ge2JhckF9ICAgIHRyYWNlIGFkZCBleGVjdXRpb24gZm9vIHtlbnRlciBsZWF2ZX0ge2JhckJ9 then the trace commands barA and barB will be invoked in the following sequence: ICAgIGJhckIge2ZvbyB4fSB7ZW50ZXJ9ICAgIGJhckEge2ZvbyB4fSB7ZW50ZXJ9ICAgICAgZm9vIHg=ICAgIGJhckEge2ZvbyB4fSAwIHt9IHtsZWF2ZX0=ICAgIGJhckIge2ZvbyB4fSAwIHt9IHtsZWF2ZX0= The creation of many enterstep or leavestep traces can lead to unintuitive results, since the invoked commands from one trace can themselves lead to further command invocations for other traces. However, these unintuitive results are completely predictable and safe (and tested in the test suite). Nevertheless the user will probably only want to have one such trace active at a time. Once created, the trace remains in effect either until the trace is removed with the trace remove execution command, until the name is deleted or until the interpreter is deleted. Note that renaming the command name will not remove the execution traces. To implement enterstep and leavestep traces, it is necessary to invoke traces regardless of at what level the command is being traced. This means that the value for level argument to Tcl_CreateTrace and Tcl_CreateObjTrace APIs should also accept 0. A value of 0 implies that commands at all levels will be traced.

The following script defines a procedure foo and illustrates several cases as to how its execution can be traced. ICAgICMgRGVmaW5lIHRoZSBwcm9jIGZvbw==ICAgIHByb2MgZm9vIHt2YXJ9IHs=ICAgICAgICAgcmV0dXJuIFtzdHJpbmcgaW5kZXggJHZhciBbZXhwciB7JHZhcioyfV1dICAgIH0=ICAgIA==ICAgICMgQ29tbWFuZCB0byBpbnZva2Ugb24gdHJhY2UgYWN0aXZhdGlvbg==ICAgIHByb2MgcHJpbnQge2FyZ3N9IHs=ICAgICAgICBwdXRzIHN0ZG91dCAiUFJJTlQ6ICRhcmdzIg==ICAgIH0=ICAgIA==ICAgIHByb2MgbWFpbiB7fSB7ICAgICAgICBwdXRzIHN0ZG91dCAiPT09PT09PT09PT09PT09PUNBU0UgMT09PT09PT09PT09PT09PT09PT09PT09PT0iICAgICAgICBwdXRzIHN0ZG91dCAiVHJhY2UgcHJvYyBmb28gb25seSI=ICAgICAgICB0cmFjZSBhZGQgZXhlY3V0aW9uIGZvbyB7ZW50ZXIgbGVhdmV9IHtwcmludCBleGVjfQ==ICAgICAgICBmb28gNA==ICAgIA==ICAgICAgICBwdXRzIHN0ZG91dCAiPT09PT09PT09PT09PT09PUNBU0UgMj09PT09PT09PT09PT09PT09PT09PT09PT0iICAgICAgICBwdXRzIHN0ZG91dCAiVHJhY2UgcHJvYyBmb28gYXMgd2VsbCBhcyBhbGwgY29tbWFuZHMgd2l0aGluIGl0Ig==ICAgICAgICB0cmFjZSBhZGQgZXhlY3V0aW9uIGZvbyB7ZW50ZXJzdGVwIGxlYXZlc3RlcH0ge3ByaW50IHN0ZXB9ICAgICAgICBmb28gNA==ICAgIA==ICAgICAgICAjIFJlbW92ZSBhbGwgdHJhY2VzICAgICAgICB0cmFjZSByZW1vdmUgZXhlY3V0aW9uIGZvbyB7ZW50ZXIgbGVhdmV9IHtwcmludCBleGVjfQ==ICAgICAgICB0cmFjZSByZW1vdmUgZXhlY3V0aW9uIGZvbyB7ZW50ZXJzdGVwIGxlYXZlc3RlcH0ge3ByaW50IHN0ZXB9ICAgIA==ICAgICAgICBwdXRzIHN0ZG91dCAiPT09PT09PT09PT09PT09PUNBU0UgMz09PT09PT09PT09PT09PT09PT09PT09PT0iICAgICAgICBwdXRzIHN0ZG91dCAiQWRkIGEgdHJhY2Ugb24gc3RyaW5nIGNvbW1hbmQiICAgICAgICB0cmFjZSBhZGQgZXhlY3V0aW9uIHN0cmluZyB7ZW50ZXIgbGVhdmV9IHtwcmludCBleGVjfQ==ICAgICAgICBmb28gNA==ICAgICAgICB0cmFjZSByZW1vdmUgZXhlY3V0aW9uIHN0cmluZyB7ZW50ZXIgbGVhdmV9IHtwcmludCBleGVjfQ==ICAgIH0=ICAgIG1haW4= The expected output of running the above script would be: ICAgID09PT09PT09PT09PT09PT09PT1DQVNFIDE9PT09PT09PT09PT09PT09PT09PT09PT0=ICAgIFRyYWNlIHByb2MgZm9vIG9ubHk=ICAgIFBSSU5UOiBleGVjIHtmb28gNH0gZW50ZXI=ICAgIFBSSU5UOiBleGVjIHtmb28gNH0gMCB7fSBsZWF2ZQ==ICAgID09PT09PT09PT09PT09PT09PT1DQVNFIDI9PT09PT09PT09PT09PT09PT09PT09PQ==ICAgIFRyYWNlIHByb2MgZm9vIGFzIHdlbGwgYXMgYWxsIGNvbW1hbmRzIHdpdGhpbiBpdA==ICAgIFBSSU5UOiBleGVjIHtmb28gNH0gZW50ZXI=ICAgIFBSSU5UOiBzdGVwIHtleHByIHskdmFyKjJ9fSBlbnRlcnN0ZXA=ICAgIFBSSU5UOiBzdGVwIHtleHByIHskdmFyKjJ9fSAwIDggbGVhdmVzdGVwICAgIFBSSU5UOiBzdGVwIHtzdHJpbmcgaW5kZXggNCA4fSBlbnRlcnN0ZXA=ICAgIFBSSU5UOiBzdGVwIHtzdHJpbmcgaW5kZXggNCA4fSAwIHt9IGxlYXZlc3RlcA==ICAgIFBSSU5UOiBzdGVwIHtyZXR1cm4ge319IGVudGVyc3RlcA==ICAgIFBSSU5UOiBzdGVwIHtyZXR1cm4ge319IDIge30gbGVhdmVzdGVwICAgIFBSSU5UOiBleGVjIHtmb28gNH0gMCB7fSBsZWF2ZQ==ICAgID09PT09PT09PT09PT09PT09PT1DQVNFIDM9PT09PT09PT09PT09PT09PT09PT09PQ==ICAgIEFkZCBhIHRyYWNlIG9uIHN0cmluZyBjb21tYW5kICAgIFBSSU5UOiBleGVjIHtzdHJpbmcgaW5kZXggNCA4fSBlbnRlcg==ICAgIFBSSU5UOiBleGVjIHtzdHJpbmcgaW5kZXggNCA4fSAwIHt9IGxlYXZl Case 1 specifies a enter and leave trace on proc foo. Here the proc foo is fully byte-code-compiled. Case 2 additionally invokes a enterstep and leavestep trace on proc foo. This means that it will trace each command that is inovked within the proc foo. Here the proc foo is *not* byte-code-compiled. This is implemented by setting the DONT_COMPILE_CMDS_INLINE flag. Case 3 specifies a trace on string command only. Here all commands within proc foo, except string command, is byte-code-compiled. This is implemented by modifying compilation engine to check for CMD_HAS_EXEC_TRACES flag before generating any byte-code.

This proposal was originally implemented by Vince Darley. Please see Feature Request #462580: The original patch from Vince Darley has been modified in the following respects: For enter and enterstep operations, the original patch passed arguments to the command in its unexpanded form. This behavior has been changed to pass the arguments in its fully expanded form since it should be more useful for debugging scripts. The original patch could not trace Tcl commands that were invoked inside a procedure because tracing is currently not possible for compiled commands. Therefore, the patch was modified such that Tcl commands are no longer internally compiled if a trace has been set on a command. For multiple traces on same command, the original patch invoked the traces in the same order as they were created. This behavior was changed so that for enter and enterstep operations, the traces are invoked in the reverse order of its creation. For leave and leavestep, the traces are still invoked in the original order. The original patch was created on 2000-Sept-14. It was updated to work with the current CVS head. The latest patch for this tip 62 is available at: The main changes for the patch are described in brief next. Two new flags have been defined in tcl.h: ICAjZGVmaW5lIFRDTF9UUkFDRV9FTlRFUl9FWEVDICAgICAgICAgIDE=ICAjZGVmaW5lIFRDTF9UUkFDRV9MRUFWRV9FWEVDICAgICAgICAgIDI= These flag values are passed to Tcl_CreateObjTrace and used by command execution traces. More internal flags for slots 4, 8, 15, 16, 32 are defined in tclCmdMZ.c file: TCL_TRACE_ENTER_DURING_EXEC, TCL_TRACE_LEAVE_DURING_EXEC, TCL_TRACE_ANY_EXEC, TCL_TRACE_EXEC_IN_PROGRESS and TCL_TRACE_EXEC_DIRECT. A new function TclTraceExecutionObjCmd function implements the trace {add|remove|list} execution ... subcommands. A new function TclCheckExecutionTraces is defined to check for traces added by the execution subcommand. A new function TclCheckInterpTraces is defined to check for global traces added by the Tcl_CreateObjTrace command. The TclEvalObjvInternal has been modified to call the above two functions before as well as after the original command is executed. A new function TraceExecutionProc is invoked, when necessary, to execute the actual trace command in the interpreter. A new structure ActiveInterpTrace has been defined for internal use so that it behaves reasonably when traces are deleted while active. In tclVar.c file, the function CallTraces has been renamed to CallVarTraces and iPtr->activeTracePtr has been renamed to iPtr->activeTraceVarPtr. An additional check for (tracePtr->level == 0) has been added in Tcl_EvalObjv and TclExecuteByteCode functions, so as to enable command tracing at all levels.

The benchmark results corresponds to Version 1.1 of the reference implementation. One potential objection to this TIP could be that it may affect the performance of the Tcl-core. Therefore, I have run the runbench.tcl script from the tclbench module for comparison on a Sun Ultra5, Solaris2.6 machine. The results have been posted at These results show that there is hardly any performance hit, if any, by addition of this feature. Of course when you activate a trace on a command, then you will see a performance hit, but since primary uses of traces will be in profiling and debugging, that isn't an issue.

This proposal does not allow for the trace invocation command to do the following: modify the number of arguments passed to namemodify the value of arguments passed to namemodify the result value and result code returned by nameskip invocation of name altogether if desired. Consider the example of adding a sub-command "string reverse ..." as shown on Instead of using the rename command, it should be possible to use the trace command to do the same, as follows: ICAgIHRyYWNlIGFkZCBleGVjdXRpb24gc3RyaW5nIHtlbnRlcn0gezo6bXlsaWI6OnN0cmluZ3h9ICAgIHByb2MgOjpteWxpYjo6c3RyaW5neCB7c3ViY21kIGFyZ3N9IHs=ICAgICAgICBzd2l0Y2ggLWV4YWN0IC0tICRzdWJjbWQgew==ICAgICAgICAgICAgInJldmVyc2UiIHs=ICAgICAgICAgICAgICAgICMgSG1tIC4uLiB0aGlzIGlzIG15IHN1YmNvbW1hbmQsIHByb2Nlc3MgaXQgaGVyZQ==ICAgICAgICAgICAgICAgIHNldCByZXR1cm5WYWx1ZSBbY29kZV90b19yZXZlcnNlX3N0cmluZ192YWx1ZV0=ICAgICAgICAgICAgICAgICMgV2UgbmVlZCBhIG1lY2hhbnNpbSB0byByZXR1cm4gaW1tZWRpYXRlbHkgaGVyZQ==ICAgICAgICAgICAgICAgICMgd2l0aCB0aGUgcHJvY2Vzc2VkIHJlc3VsdHMgYW5kIGFuIGFwcHJvcHJpYXRlICAgICAgICAgICAgICAgICMgY29kZSB2YWx1ZSBhbmQgbm90IGludm9rZSB0aGUgb3JpZ2luYWwgc3RyaW5nIGNvbW1hbmQuICAgICAgICAgICAgfQ==ICAgICAgICAgICAgZGVmYXVsdCB7ICAgICAgICAgICAgICAgICMgVGhpcyBpcyBwcm9iYWJseSBhIHZhaWxkIHN1YmNvbW1hbmQsIHNvIGRvIG5vdGhpbmc=ICAgICAgICAgICAgICAgICMgYW5kIGxldCB0aGUgb3JpZ2luYWwgc3RyaW5nIGNvbW1hbmQgaGFuZGxlIGl0ICAgICAgICAgICAgfQ==ICAgICAgICB9ICAgIH0=

This document has been placed in the public domain.