Skip to content
  1. Feb 01, 2011
  2. Jan 26, 2011
    • Jason Evans's avatar
      Fix ALLOCM_LG_ALIGN definition. · f256680f
      Jason Evans authored
      Fix ALLOCM_LG_ALIGN to take a parameter and use it.  Apparently, an
      editing error left ALLOCM_LG_ALIGN with the same definition as
      ALLOCM_LG_ALIGN_MASK.
      f256680f
  3. Jan 15, 2011
    • Jason Evans's avatar
      Fix assertion typos. · dbd3832d
      Jason Evans authored
      s/=/==/ in several assertions, as well as fixing spelling errors.
      dbd3832d
    • Jason Evans's avatar
      Fix a heap dumping deadlock. · 10e45230
      Jason Evans authored
      Restructure the ctx initialization code such that the ctx isn't locked
      across portions of the initialization code where allocation could occur.
      Instead artificially inflate the cnt_merged.curobjs field, just as is
      done elsewhere to avoid similar races to the one that would otherwise be
      created by the reduction in locking scope.
      
      This bug affected interval- and growth-triggered heap dumping, but not
      manual heap dumping.
      10e45230
  4. Dec 29, 2010
    • Jason Evans's avatar
      Fix a "thread.arena" mallctl bug. · 624f2f3c
      Jason Evans authored
      When setting a new arena association for the calling thread, also update
      the tcache's cached arena pointer, primarily so that
      tcache_alloc_small_hard() uses the intended arena.
      624f2f3c
  5. Dec 18, 2010
  6. Dec 16, 2010
  7. Dec 04, 2010
  8. Dec 01, 2010
    • Jason Evans's avatar
      Use mremap(2) for huge realloc(). · cfdc8cfb
      Jason Evans authored
      If mremap(2) is available and supports MREMAP_FIXED, use it for huge
      realloc().
      
      Initialize rtree later during bootstrapping, so that --enable-debug
      --enable-dss works.
      
      Fix a minor swap_avail stats bug.
      cfdc8cfb
  9. Nov 27, 2010
    • Jason Evans's avatar
      Convert man page from roff to DocBook. · aee7fd2b
      Jason Evans authored
      Convert the man page source from roff to DocBook, and generate html and
      roff output.  Modify the build system such that the documentation can be
      built as part of the release process, so that users need not have
      DocBook tools installed.
      aee7fd2b
  10. Nov 25, 2010
    • Jason Evans's avatar
      Push down ctl_mtx. · fc4dcfa2
      Jason Evans authored
      Many mallctl*() end points require no locking, so push the locking down
      to just the functions that need it.  This is of particular import for
      "thread.allocated" and "thread.deallocated", which are intended as a
      low-overhead way to introspect per thread allocation activity.
      fc4dcfa2
  11. Nov 05, 2010
  12. Oct 30, 2010
  13. Oct 28, 2010
    • Jason Evans's avatar
      Fix prof bugs. · b04a940e
      Jason Evans authored
      Fix a race condition in ctx destruction that could cause undefined
      behavior (deadlock observed).
      
      Add mutex unlocks to some OOM error paths.
      b04a940e
  14. Oct 25, 2010
  15. Oct 24, 2010
    • Jason Evans's avatar
      Use madvise(..., MADV_FREE) on OS X. · ce93055c
      Jason Evans authored
      Use madvise(..., MADV_FREE) rather than msync(..., MS_KILLPAGES) on OS
      X, since it works for at least OS X 10.5 and 10.6.
      ce93055c
    • Jason Evans's avatar
      Edit manpage. · 0d38791e
      Jason Evans authored
      Make various minor edits to the manpage.
      0d38791e
    • Jason Evans's avatar
      Re-format size class table. · 8da141f4
      Jason Evans authored
      Use a more compact layout for the size class table in the man page.
      This avoids layout glitches due to approaching the single-page table
      size limit.
      8da141f4
    • Jason Evans's avatar
      Add missing #ifdef JEMALLOC_PROF. · 49d0293c
      Jason Evans authored
      Only call prof_boot0() if profiling is enabled.
      49d0293c
    • Jason Evans's avatar
      Replace JEMALLOC_OPTIONS with MALLOC_CONF. · e7339706
      Jason Evans authored
      Replace the single-character run-time flags with key/value pairs, which
      can be set via the malloc_conf global, /etc/malloc.conf, and the
      MALLOC_CONF environment variable.
      
      Replace the JEMALLOC_PROF_PREFIX environment variable with the
      "opt.prof_prefix" option.
      
      Replace umax2s() with u2s().
      e7339706
  16. Oct 22, 2010
    • Jason Evans's avatar
      Fix heap profiling bugs. · e4f7846f
      Jason Evans authored
      Fix a regression due to the recent heap profiling accuracy improvements:
      prof_{m,re}alloc() must set the object's profiling context regardless of
      whether it is sampled.
      
      Fix management of the CHUNK_MAP_CLASS chunk map bits, such that all
      large object (re-)allocation paths correctly initialize the bits.  Prior
      to this fix, in-place realloc() cleared the bits, resulting in incorrect
      reported object size from arena_salloc_demote().  After this fix the
      non-demoted bit pattern is all zeros (instead of all ones), which makes
      it easier to assure that the bits are properly set.
      e4f7846f
  17. Oct 21, 2010
    • Jason Evans's avatar
      Fix a heap profiling regression. · 81b4e6eb
      Jason Evans authored
      Call prof_ctx_set() in all paths through prof_{m,re}alloc().
      
      Inline arena_prof_ctx_get().
      81b4e6eb
    • Jason Evans's avatar
      Inline the fast path for heap sampling. · 4d6a134e
      Jason Evans authored
      Inline the heap sampling code that is executed for every allocation
      event (regardless of whether a sample is taken).
      
      Combine all prof TLS data into a single data structure, in order to
      reduce the TLS lookup volume.
      4d6a134e
    • Jason Evans's avatar
      Add per thread allocation counters, and enhance heap sampling. · 93443689
      Jason Evans authored
      Add the "thread.allocated" and "thread.deallocated" mallctls, which can
      be used to query the total number of bytes ever allocated/deallocated by
      the calling thread.
      
      Add s2u() and sa2u(), which can be used to compute the usable size that
      will result from an allocation request of a particular size/alignment.
      
      Re-factor ipalloc() to use sa2u().
      
      Enhance the heap profiler to trigger samples based on usable size,
      rather than request size.  This has a subtle, but important, impact on
      the accuracy of heap sampling.  For example, previous to this change,
      16- and 17-byte objects were sampled at nearly the same rate, but
      17-byte objects actually consume 32 bytes each.  Therefore it was
      possible for the sample to be somewhat skewed compared to actual memory
      usage of the allocated objects.
      93443689
  18. Oct 19, 2010
    • Jason Evans's avatar
      Fix a bug in arena_dalloc_bin_run(). · 21fb95bb
      Jason Evans authored
      Fix the newsize argument to arena_run_trim_tail() that
      arena_dalloc_bin_run() passes.  Previously, oldsize-newsize (i.e. the
      complement) was passed, which could erroneously cause dirty pages to be
      returned to the clean available runs tree.  Prior to the
      CHUNK_MAP_ZEROED --> CHUNK_MAP_UNZEROED conversion, this bug merely
      caused dirty pages to be unaccounted for (and therefore never get
      purged), but with CHUNK_MAP_UNZEROED, this could cause dirty pages to be
      treated as zeroed (i.e. memory corruption).
      21fb95bb
  19. Oct 18, 2010
    • Jason Evans's avatar
      Fix arena bugs. · 088e6a0a
      Jason Evans authored
      Split arena_dissociate_bin_run() out of arena_dalloc_bin_run(), so that
      arena_bin_malloc_hard() can avoid dissociation when recovering from
      losing a race.  This fixes a bug introduced by a recent attempted fix.
      
      Fix a regression in arena_ralloc_large_grow() that was introduced by
      recent fixes.
      088e6a0a
    • Jason Evans's avatar
      Fix arena bugs. · 8de6a028
      Jason Evans authored
      Move part of arena_bin_lower_run() into the callers, since the
      conditions under which it should be called differ slightly between
      callers.
      
      Fix arena_chunk_purge() to omit run size in the last map entry for each
      run it temporarily allocates.
      8de6a028
    • Jason Evans's avatar
      Add assertions to run coalescing. · 12ca9140
      Jason Evans authored
      Assert that the chunk map bits at the ends of the runs that participate
      in coalescing are self-consistent.
      12ca9140
    • Jason Evans's avatar
      Fix numerous arena bugs. · 940a2e02
      Jason Evans authored
      In arena_ralloc_large_grow(), update the map element for the end of the
      newly grown run, rather than the interior map element that was the
      beginning of the appended run.  This is a long-standing bug, and it had
      the potential to cause massive corruption, but triggering it required
      roughly the following sequence of events:
        1) Large in-place growing realloc(), with left-over space in the run
           that followed the large object.
        2) Allocation of the remainder run left over from (1).
        3) Deallocation of the remainder run *before* deallocation of the
           large run, with unfortunate interior map state left over from
           previous run allocation/deallocation activity, such that one or
           more pages of allocated memory would be treated as part of the
           remainder run during run coalescing.
      In summary, this was a bad bug, but it was difficult to trigger.
      
      In arena_bin_malloc_hard(), if another thread wins the race to allocate
      a bin run, dispose of the spare run via arena_bin_lower_run() rather
      than arena_run_dalloc(), since the run has already been prepared for use
      as a bin run.  This bug has existed since March 14, 2010:
          e00572b3
          mmap()/munmap() without arena->lock or bin->lock.
      
      Fix bugs in arena_dalloc_bin_run(), arena_trim_head(),
      arena_trim_tail(), and arena_ralloc_large_grow() that could cause the
      CHUNK_MAP_UNZEROED map bit to become corrupted.  These are all
      long-standing bugs, but the chances of them actually causing problems
      was much lower before the CHUNK_MAP_ZEROED --> CHUNK_MAP_UNZEROED
      conversion.
      
      Fix a large run statistics regression in arena_ralloc_large_grow() that
      was introduced on September 17, 2010:
          8e3c3c61
          Add {,r,s,d}allocm().
      
      Add debug code to validate that supposedly pre-zeroed memory really is.
      940a2e02
  20. Oct 17, 2010
    • Jason Evans's avatar
      Preserve CHUNK_MAP_UNZEROED for small runs. · 397e5111
      Jason Evans authored
      Preserve CHUNK_MAP_UNZEROED when allocating small runs, because it is
      possible that untouched pages will be returned to the tree of clean
      runs, where the CHUNK_MAP_UNZEROED flag matters.  Prior to the
      conversion from CHUNK_MAP_ZEROED, this was already a bug, but in the
      worst case extra zeroing occurred.  After the conversion, this bug made
      it possible to incorrectly treat pages as pre-zeroed.
      397e5111
  21. Oct 14, 2010
    • Jason Evans's avatar
      Fix a regression in CHUNK_MAP_UNZEROED change. · 004ed142
      Jason Evans authored
      Fix a regression added by revision:
      
      	3377ffa1
      	Change CHUNK_MAP_ZEROED to CHUNK_MAP_UNZEROED.
      
      A modified chunk->map dereference was missing the subtraction of
      map_bias, which caused incorrect chunk map initialization, as well as
      potential corruption of the first non-header page of memory within each
      chunk.
      004ed142
  22. Oct 07, 2010
    • Jason Evans's avatar
      Re-organize prof-libgcc configuration. · ac6f3c2b
      Jason Evans authored
      Re-organize code for --enable-prof-libgcc so that configure doesn't
      report both libgcc and libunwind support as being configured in.  This
      change has no impact on how jemalloc is actually configured/built.
      ac6f3c2b