After ignoring StackOverflow for a while, I decided to check up on it a bit lately. Someone asked a question
that's one of those kind of fundamental curiosity issues that I enjoy explaining. He said:
I always thought that functions like printf() are in the last step defined using inline assembly. That deep into stdio.h is buried some asm code that actually tells CPU what to do. Something like in dos, first mov beginning of the string to some memory location or register and than call some int. But since x64 version of Visual Studio doesn't support inline assembler at all, it made me think that there are really no assembler-defined functions in C/C++. So, please, how is for example printf() defined in C/C++ without using assembler code? What actually executes the right software interrupt?
Obviously the answer is going to depend on the implementation. Yet I thought that with the open-sourced GNU C Library, it would be pretty straightforward to show how most of it is in C but it bottoms out at
syscall. But it really was quite a maze to connect all the dots without doing any hand-waving! So I found that my explanation just kept growing until it was so long that a blog entry was a more fitting format.
So read on, fearless explorers, as we dig into the complicated answer to a seemingly simple question...
We'll of course start with the prototype for
, which is defined in the file libc/libio/stdio.h
extern int printf (__const char *__restrict __format, ...);
You won't find the source code for a function called
, however. Instead, in the file /libc/stdio-common/printf.c
you'll find a little bit of code associated with a function called
int __printf (const char *format, ...)
va_start (arg, format);
done = vfprintf (stdout, format, arg);
A macro in the same file sets up an association so that this function is defined as an alias for the non-underscored
ldbl_strong_alias (__printf, printf);
It makes sense that
would be a thin layer that calls
. Indeed, the meat of the formatting work is done in
, which you'll find in libc/stdio-common/vfprintf.c
. It's quite a lengthy function, but you can see that it's still all in C!
Deeper Down the Rabbit Hole...
vfprintf mysteriously calls
outstring, which are weird macros defined in the same file:
#define outchar(Ch) \
register const INT_T outc = (Ch); \
if (PUTC (outc, s) == EOF || done == INT_MAX) \
done = -1; \
goto all_done; \
Sidestepping the question of why it's so weird, we see that it's dependent on the enigmatic
PUTC, also in the same file:
#define PUTC(C, F) IO_putwc_unlocked (C, F)
When you get to the definition of
, you might start thinking that you no longer care how
#define _IO_putwc_unlocked(_wch, _fp) \
(_IO_BE ((_fp)->_wide_data->_IO_write_ptr \
>= (_fp)->_wide_data->_IO_write_end, 0) \
? __woverflow (_fp, _wch) \
: (_IO_wint_t) (*(_fp)->_wide_data->_IO_write_ptr++ = (_wch)))
But despite being a little hard to read, it's just doing buffered output. If there's enough room in the file pointer's buffer, then it will just stick the character into it...but if not, it calls
__woverflow. Since the only option when you've run out of buffer is to flush to the screen (or whatever device your file pointer represents), we can hope to find the magic incantation there.
Vtables in C?
If you guessed that we're going to hop through another frustrating level of indirection, you'd be right. Look in libc/libio/wgenops.c
and you'll find the definition of
__woverflow (f, wch)
if (f->_mode == 0)
_IO_fwide (f, 1);
return _IO_OVERFLOW (f, wch);
Basically, file pointers are implemented in the GNU standard library as objects. They have data members but also function members which you can call with variations of the
macro. In the file libc/libio/libioP.h
you'll find a little documentation of this technique:
/* THE JUMPTABLE FUNCTIONS.
* The _IO_FILE type is used to implement the FILE type in GNU libc,
* as well as the streambuf class in GNU iostreams for C++.
* These are all the same, just used differently.
* An _IO_FILE (or FILE) object is allows followed by a pointer to
* a jump table (of pointers to functions). The pointer is accessed
* with the _IO_JUMPS macro. The jump table has a eccentric format,
* so as to be compatible with the layout of a C++ virtual function table.
* (as implemented by g++). When a pointer to a streambuf object is
* coerced to an (_IO_FILE*), then _IO_JUMPS on the result just
* happens to point to the virtual function table of the streambuf.
* Thus the _IO_JUMPS function table used for C stdio/libio does
* double duty as the virtual function table for C++ streambuf.
* The entries in the _IO_JUMPS function table (and hence also the
* virtual functions of a streambuf) are described below.
* The first parameter of each function entry is the _IO_FILE/streambuf
* object being acted on (i.e. the 'this' parameter).
So when we find
, we find it's a macro which calls a "1-parameter"
method on the file pointer:
#define IO_OVERFLOW(FP, CH) JUMP1 (__overflow, FP, CH)
const struct _IO_jump_t _IO_file_jumps =
There's also a #define which equates
_IO_file_overflow, and the former is defined in the same source file.
INTUSE is just a macro which marks functions that are for internal use, it doesn't mean anything like "this function uses an interrupt")
Are we there yet?!
The source code for
_IO_new_file_overflow does a bunch more buffer manipulation, but it does call
#define _IO_do_flush(_f) \
INTUSE(_IO_do_write)(_f, (_f)->_IO_write_base, \
We're now at a point where
_IO_do_write is probably where the rubber actually meets the road: an unbuffered, actual, direct write to an I/O device. At least we can hope! It is mapped by a macro to
_IO_new_do_write and we have this:
new_do_write (fp, data, to_do)
const char *data;
if (fp->_flags & _IO_IS_APPENDING)
/* On a system without a proper O_APPEND implementation,
you would need to sys_seek(0, SEEK_END) here, but is
is not needed nor desirable for Unix- or Posix-like systems.
Instead, just indicate that offset (before and after) is
fp->_offset = _IO_pos_BAD;
else if (fp->_IO_read_end != fp->_IO_write_base)
= _IO_SYSSEEK (fp, fp->_IO_write_base - fp->_IO_read_end, 1);
if (new_pos == _IO_pos_BAD)
fp->_offset = new_pos;
count = _IO_SYSWRITE (fp, data, to_do);
if (fp->_cur_column && count)
fp->_cur_column = INTUSE(_IO_adjust_column) (fp->_cur_column - 1, data,
- count) + 1;
_IO_setg (fp, fp->_IO_buf_base, fp->_IO_buf_base, fp->_IO_buf_base);
fp->_IO_write_base = fp->_IO_write_ptr = fp->_IO_buf_base;
fp->_IO_write_end = (fp->_mode <= 0
&& (fp->_flags & (_IO_LINE_BUF+_IO_UNBUFFERED))
? fp->_IO_buf_base : fp->_IO_buf_end);
Sadly we're stuck again...
_IO_SYSWRITE is doing the work:
/* The 'syswrite' hook is used to write data from an existing buffer
to an external file. It generalizes the Unix write(2) function.
It matches the streambuf::sys_write virtual function, which is
specific to this implementation. */
typedef _IO_ssize_t (*_IO_write_t) (_IO_FILE *, const void *, _IO_ssize_t);
#define _IO_SYSWRITE(FP, DATA, LEN) JUMP2 (__write, FP, DATA, LEN)
#define _IO_WSYSWRITE(FP, DATA, LEN) WJUMP2 (__write, FP, DATA, LEN)
So inside of the
do_write we call the
write method on the file pointer. We know from our jump table above that is mapped to
_IO_new_file_write, so what's that do?
_IO_new_file_write (f, data, n)
const void *data;
_IO_ssize_t to_do = n;
while (to_do > 0)
_IO_ssize_t count = (__builtin_expect (f->_flags2
& _IO_FLAGS2_NOTCANCEL, 0)
? write_not_cancel (f->_fileno, data, to_do)
: write (f->_fileno, data, to_do));
if (count < 0)
f->_flags |= _IO_ERR_SEEN;
to_do -= count;
data = (void *) ((char *) data + count);
n -= to_do;
if (f->_offset >= 0)
f->_offset += n;
Now it just calls
! Well where is the implementation for that? You'll find
/* Write N bytes of BUF to FD. Return the number written, or -1.
This function is a cancellation point and therefore not marked with
extern ssize_t write (int __fd, __const void *__buf, size_t __n) __wur;
__wur is a macro for
Functions Generated From a Table
That's only a prototype for
. You won't find a write.c file for Linux in the GNU standard library. Instead, you'll find platform-specific methods of connecting to the OS write function in various ways, all in the libc/sysdeps/
We'll keep following along with how Linux does it. There is a file called sysdeps/unix/syscalls.list
which is used to generate the
function automatically. The relevant data from the table is:
File name: write
Caller: "-" (i.e. Not Applicable)
Syscall name: write
Strong name: __libc_write
Weak names: __write, write
Not all that mysterious, except for the Ci:ibn
. The C means "cancellable". The colon separates the return type from the argument types, and if you want a deeper explanation of what they mean then you can see the comment in the shell script which generates the code, libc/sysdeps/unix/make-syscalls.sh
So now we're expecting to be able to link against a function called
which is generated by this shell script. But what's being generated? Some C code which implements write via a macro called
, which you'll find in sysdeps/unix/sysdep.h
#define SYS_ify(syscall_name) __NR_##syscall_name
Ah, good old token-pasting :P. So basically, the implementation of this
__libc_write becomes nothing more than a proxy invocation of the
syscall function with a parameter named
__NR_write, and the other arguments.
Where The Sidewalk Ends...
I know this has been a fascinating journey, but now we're at the end of GNU libc. That number
is defined by Linux. For 32-bit X86 architectures it will get you to linux/arch/x86/include/asm/unistd_32.h
#define __NR_write 4
This is the final step where the "rubber meets the road", but how it is done is system-dependent. That would make an article in itself, but we've found where the rubber meets the road. What you want to read up on to go further is this thing called "syscall"