flanchan
/
collect
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
48 Commits
4 Branches
0 Tags
196 KiB
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '14f32d6262'
${ noResults }
Commit Graph

48 Commits (14f32d62625e9683afe1540dc2db586b7331f2c7)
 

Author SHA1 Message Date
Avril 14f32d6262
Explicitly closes `stdout` before process exits.
2 years ago
Avril bc2357c6b6
Attempted to add new feature flag: `memfile-size-output`: Which will pre- or post- set the size of `stdout` to the correct buffer size, allowing consumers of `collect`"s stdout pipe to know the size just like a file. However, `ftruncate()` always fails on stdout. Before re-enabling the feature, we must find out how to set the size of a pipe, if/when you even can, and what syscall(s) you need to do it with.
2 years ago
Avril b2bf26f245
Bumped minor version.
2 years ago
Avril ab56c93532
Bumped minor version.
2 years ago
Avril 395799587b
Removed `stackalloc` dependancy.
2 years ago
Avril 289db974cd
TODO: Find out how to set the length of stdout if possible, so that the consumer of `collect` in a pipeline need only use one syscall splice() to read all the collected data at once, like a file.
2 years ago
Avril b47a27c60f
(partial-merge from (probably) now-defunct branch `hugetlb`.)
2 years ago
Avril 35c6cabce3
memfile::hp: Changed `get_masks()` to return an iterator of `SizedMask` instead of just `Mask` to retain the size of the huge-page itself in bytes (for `ftruncate()` calls, and `mmap()` calls.)
2 years ago
Avril dbf2dbffde
Removed `hugetlb` feature flag: It cannot be used for our use-case.
2 years ago
Avril 8ea3a23e27
Using huge-pages for this is folly from the start: For one, we never actually map the fallocate()"d memory. And two... hugetlbfs does not support write()s in any way, splice()s, send_file()s... It only supports read(), and mmap() (its primary use-case...); which isn"t relevant for us.
2 years ago
Avril 872ea74421
It seems creating HUGETLB memory files either just doesn"t work or changes their behaviour so that any (or at least, small arbitrary) writing or fallocate()ing to them fails... Read up on MFD_HUGETLB more then re-do a test like `memfd_create_wrapper()` to find out why... and if it depends on the MAP_HUGE_ mask, and if so, find one that works... (We know when masks are invalid, since the error message is different. The masks collected via `get_masks()` *are* valid for this system, they just prevent the fd from being any way useful.)
2 years ago
Avril bdfd0a6268
memfile::hp: Added `PartialEq` impl for `c_int` (checks `MAP_HUGE` from `.raw()`), and `c_uint` (checks `memfd_create()` useable constant from `.mask()`.)
2 years ago
Avril 573845a667
memfile::hp: Added `get_masks()`: Returns an iterator over all `MAP_HUGE` masks found on system.
2 years ago
Avril 9b4bb475c0
Added extension methods for flattening `eyre::Result<eyre:Result<T>>`s and related constructs.
2 years ago
Avril e7b96af012
memfile::hp: Added test for `Mask`"s `.raw()` (`MAP_HHUGE_` flag generation.)
2 years ago
Avril c4f73ccfa0
memfile::hp: `find_size_bytes()` fixed and tested; should change function to return `eyre::Result<usize>` instead of `Option<usize>` considering how many different failure-paths exist.
2 years ago
Avril 9c18a5b940
memfile::hp: Added `Mask`: Converts bytes into a suitable `MAP_HUGE_` constant via its `.raw()` method, and a suitable flag for `memfd_create()` via its `.mask()` method.
2 years ago
Avril b882f0ae97
Completed `hp::find_size_bytes()`, and added const-generated lookup table for non "k" seperators.
2 years ago
Avril d46efebbf7
Added huge-page mask calculation algorithm to comment of module file `memfile::hp`.
2 years ago
Avril b1a64475f6
Merge branch 'master' into safe-memfd: memfile: Merged `RawFile::try_link_from()`: Analogue to `try_link_to()`.
2 years ago
Avril c6032467fa
memfile: Added `RawFile::try_link_from()`: Analogue to `try_link_to()`. Instrumented and added panicking versions of both functions. Added `clone_from()` impl that uses `try_link_from()` (i.e. `dup2()`)
2 years ago
Avril 59363848a2
Started: `memfile::hp`: `MFD_HUGETLB` can be used when a size is known to exceed into the boundary of a hugepage. Currently in the process of writing function to collect all possible hugepage sizes and generate the correct flag masks for `memfd_create(, MFD_HUGETLB | ...)` for each one; and the smallest one that contains the known size can be used for the `memfd_create()` call (if the size fits any at all.)
2 years ago
Avril bbed62e738
Version bump (revision): v1.0.2
2 years ago
Avril 2c839da13b
Bumped stackalloc version: Use PLT for trampoline: Causing random linker errors on some machines.
2 years ago
Avril 0262ca88d9
Added TODOs for specific bugs (and impl related ideas for how to go about preventing/warning in the event of `mode-memfd` system OOM) ; moved some RawFd-related functions into a submodule
2 years ago
Avril 8dd7ddaed8
Version bump v1.0.1
2 years ago
Avril 9ecd0ea3d8
Fixed silly bug preventing building on rust-stable.
2 years ago
Avril 1e207ca453
Create LICENSE
2 years ago
Avril 9125199d80
Added Cargo keywords (tags)
2 years ago
Avril 225a0a08f0
Fix README
2 years ago
Avril 8fe92b0951
Version 1.0.0!
2 years ago
Avril f05c1466c7
Added README.md
2 years ago
Avril 8390072309
Reached version 1.0.0!
2 years ago
Avril 515a63c3a2
Fixed bug with `memfile` feature not setting stream length properly without `memfile-preallocate`
2 years ago
Avril 23d022b5fe
Added working memfile implementation
2 years ago
Avril 0628853b43
Working memfile implementation
2 years ago
Avril edb57c7c95
memfile: Disambiguated memfile errors resulting in `fallocate()` sizes being too large or the call itself failing.
2 years ago
Avril b3dbb30deb
Fix imports for when feature `memfile` is disabled.
2 years ago
Avril ed957bcec8
feature memfile: added `RawFile::open_mem()`
2 years ago
Avril 65c297b228
Started adding `memfile` feature: Use a `memfd_create()`d in-memory temporary file.
2 years ago
Avril 80a2d65262
Made spantrace capture optional at the compilation level.
2 years ago
Avril 3af34dc78f
Better documented `jemalloc` feature.
2 years ago
Avril cc37f604f1
Fixed tracing causing huge unneeded bottleneck in non `bytes` builds.
2 years ago
Avril bea5cda4a1
Fixed not copying to buffer when not using feature `bytes`.
2 years ago
Avril 1cdd5b2187
Made `bytes` an optional feature.
2 years ago
Avril 4cf1c88a3f
Update gitignore
2 years ago
Avril a5ad02a6de Working primitive, slow, prototype.
2 years ago
Avril 2aa8c832de
initial commit: must figure out how splice() works before we continue here.
2 years ago