-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upgrade bazel-ios-fork to v2.9.0 #8
base: bazel-ios-fork
Are you sure you want to change the base?
Upgrade bazel-ios-fork to v2.9.0 #8
Commits on Jun 3, 2023
-
Handle null Throwable message in asExecutionStatus (buildfarm#1357)
Throwable indicates that the response to getMessage() may be null.
Configuration menu - View commit details
-
Copy full SHA for 82a485f - Browse repository at this point
Copy the full SHA 82a485fView commit details
Commits on Jun 4, 2023
-
Update docs to include redis requirement (buildfarm#1359)
Cleaned up some links and language
Configuration menu - View commit details
-
Copy full SHA for 4b5f2a9 - Browse repository at this point
Copy the full SHA 4b5f2a9View commit details
Commits on Jun 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 74455c8 - Browse repository at this point
Copy the full SHA 74455c8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0f512d3 - Browse repository at this point
Copy the full SHA 0f512d3View commit details
Commits on Jun 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for bb6ba79 - Browse repository at this point
Copy the full SHA bb6ba79View commit details
Commits on Jun 14, 2023
-
Correct executeWorkers removal and expire (buildfarm#1367)
Removed short circuit for executeWorkers which should never inspire publish Added memoized recentExecuteWorkers which will be delayed by currently const workerSetMaxAge Cleaned up getStorageWorkers, used grpc Deadline as premium, though already expired is awkward Storage removal is overzealous and will remove matching execute workers. Received worker changes continue to only affect storage.
Configuration menu - View commit details
-
Copy full SHA for c084fa1 - Browse repository at this point
Copy the full SHA c084fa1View commit details
Commits on Jun 15, 2023
-
Adjust Server/Worker configs after parser (buildfarm#1370)
Adjustments will make use of options. Ensure that they have the specified values from the commandline, and they have no checked exception throws.
Configuration menu - View commit details
-
Copy full SHA for d0b1d1d - Browse repository at this point
Copy the full SHA d0b1d1dView commit details
Commits on Jun 18, 2023
-
Handle oversized FMBs in StubInstance by splitting (buildfarm#1377)
FMBs over a specified size limit (4MB in practice from grpc limits) will be split log2n until under the limit to make requests. Tests added to verify this. Coverage of split behavior confirmed. Fixes buildfarm#1375
Configuration menu - View commit details
-
Copy full SHA for d953f42 - Browse repository at this point
Copy the full SHA d953f42View commit details -
Missing directories not visited in validation (buildfarm#1378)
A directory which is missing during the course of validation should not be identified as missing. This prevents a NPE and inspires validation to emit one MISSING violation per path to a missing directory for preconditions. Fixes buildfarm#1374
Configuration menu - View commit details
-
Copy full SHA for dd52f13 - Browse repository at this point
Copy the full SHA dd52f13View commit details -
Guard directory revisit with empty/missing checks (buildfarm#1379)
Directories reevaluated only under the enumeration hierarchy must still be guarded against empty child directories in their checks, and must handle child directories missing in the index safely, with precondition failures matching their outputs. Order is not guaranteed in precondition output, but tests now guard this case. Fixes buildfarm#1299
Configuration menu - View commit details
-
Copy full SHA for 212e8a5 - Browse repository at this point
Copy the full SHA 212e8a5View commit details -
Output additions to RequestMetadata (buildfarm#1380)
Include Action Mnemonic, Target Id, and Configuration Id in the bf-cat output suite for RequestMetadata.
Configuration menu - View commit details
-
Copy full SHA for fe0fe8b - Browse repository at this point
Copy the full SHA fe0fe8bView commit details
Commits on Jun 20, 2023
-
SEVERE for app.run failure (buildfarm#1382)
An invocation of app.run which fails for any reason in the spring framework will exit silently. Ensure that errors are presented before exiting the application.
Configuration menu - View commit details
-
Copy full SHA for 5a1747d - Browse repository at this point
Copy the full SHA 5a1747dView commit details
Commits on Jun 21, 2023
-
Enable custom latency buckets (buildfarm#1376)
* Enable custom latency buckets * run formatter * Remove unused load from build * Run buildifier * update example config with infinity bucket --------- Co-authored-by: Trevor Hickey <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for e99878b - Browse repository at this point
Copy the full SHA e99878bView commit details -
Require fileStore for Directories interactions (buildfarm#1385)
Avoid fileStore recalculation for entire trees to be deleted, instead expect the callers to provide a fileStore, and that the entire tree exists within it.
Configuration menu - View commit details
-
Copy full SHA for 3d72cbd - Browse repository at this point
Copy the full SHA 3d72cbdView commit details -
Unwrap EEs on PutDirectoryException creation (buildfarm#1386)
ExceutionExceptions wrap the actual exceptions of futures experienced during putDirectory, and add no tracing capacity. Unwrap these when thrown from failed futures.
Configuration menu - View commit details
-
Copy full SHA for 5804462 - Browse repository at this point
Copy the full SHA 5804462View commit details
Commits on Jun 22, 2023
-
Retry downloads in CFC with copyExternalInput (buildfarm#1387)
Bleed grpc exposure into a retrier for copyExternalInput invocations, and ensure that enough bytes have been provided from the requested blob before returning.
Configuration menu - View commit details
-
Copy full SHA for 7e9dd51 - Browse repository at this point
Copy the full SHA 7e9dd51View commit details -
Skip isReadOnlyExecutable on symlinks (buildfarm#1383)
The only presence of arbitrary symlinks in the CAS Filesystem is under directories. Symlinks are explicitly identified as non-readonly-executables. Prevent a dead symlink from throwing NSFE due to the readonly check.
Configuration menu - View commit details
-
Copy full SHA for 7be0264 - Browse repository at this point
Copy the full SHA 7be0264View commit details -
Support UTF8 Strings in ffiReaddir (buildfarm#1388)
Files are delivered via readdir in utf8 encoding (on linux for xfs at least), assume that posix will mandate this.
Configuration menu - View commit details
-
Copy full SHA for 6de1473 - Browse repository at this point
Copy the full SHA 6de1473View commit details -
Configuration menu - View commit details
-
Copy full SHA for ee8b171 - Browse repository at this point
Copy the full SHA ee8b171View commit details -
Rollback ensure deadline (buildfarm#1390)
* Guard against fetchBlobFromWorker orphanization Any exception thrown by fetchBlobFromWorker will leave the blobObserver hanging. Ensure that the observer sees a failure and does not hang. * Restore FMB functionality included in revert.
Configuration menu - View commit details
-
Copy full SHA for 41a90be - Browse repository at this point
Copy the full SHA 41a90beView commit details
Commits on Jun 25, 2023
-
Interpret ExecDirException to Status (buildfarm#1391)
Handle ExecDirExceptions in InputFetcher such that the client can observe a FAILED_PRECONDITION with PreconditionFailures that include Violations with VIOLATION_TYPE_MISSING to inspire virtuous loop reestablishment. A ViolationException acts as a container for this, and can be extended to include the components of a putDirectory. Interpret PutDirectoryExceptions with their imposed violations. Missing inputs at the time of execute, whether linked as immediate files or through the directory cache, will be interpreted as VIOLATION_TYPE_MISSING.
Configuration menu - View commit details
-
Copy full SHA for b0ca1c2 - Browse repository at this point
Copy the full SHA b0ca1c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 653da3f - Browse repository at this point
Copy the full SHA 653da3fView commit details
Commits on Jun 28, 2023
-
Handle inaccurate information in backplane for fmb call (buildfarm#1381)
### Problem When workers die, their stored references are not removed from the backplane. This creates the possibility that new workers may come up with the same IP address or use an IP address previously used by another terminated host. As a result, the backplane becomes unreliable, requiring us to query each worker individually to find missing blobs. Clearly, this approach is not scalable since any problems encountered by a single worker can significantly impact the performance of the buildfarm. ### Past Work We made code modifications for the `findMissingBlobs` function to exclusively query the backplane, prs: buildfarm#1310, buildfarm#1333, and buildfarm#1342. This update implemented the `findMissingViaBackplane` flag. However, the above issues made the `findMissingViaBackplane` flag ineffective. ### Solution To address the issue of imposter workers, updated code to compare the start time of each worker (first_registered_at) with the insertion time of the digest. Any worker whose start time is later than the digest insertion time is considered an imposter worker. Also, the code removes imposter workers associated with the digest in the same function call. **first_registered_at**: Added new field first_registered_at to the worker data type. This field stores the initial start time of the worker. Worker informs the backplane about its start time, which is the same as the creation time of the cache directory (where all digests are stored) on the worker's disk. **digest insert time**: The digest insertion time is calculated using the Time to Live (TTL) of the digest and the casExpire time. The formula for determining the digest insertion time is now() - configured casExpire + remaining ttl. In the current implementation, each worker updates the TTL of the digest upon completing the write operation. This means that the cas insert time in the backplane corresponds to the time when the last worker finished writing the digest on its disk. ### Testing Deployed the change to our buildfarm staging, and ran full monorepo build. To make sure that the code change solve terminated worker problem, terminated bunch of workers in the middle of build. This caused temporary not_found `error`, which eventually faded away (fmb call autocorrect blob location). <img width="1385" alt="Screenshot 2023-06-21 at 12 36 47 PM" src="https://github.com/bazelbuild/bazel-buildfarm/assets/119983081/62fcf8e0-847a-4632-b49e-cef2c17321dc"> In the above graph terminated workers during first build. ### Future Improvement The above solution might not work if user updates `cas_expire` time between two deployments as algorithm to calculate `digest_insert_time` depends to `cas_expire` time. closes buildfarm#1371
Configuration menu - View commit details
-
Copy full SHA for ccee33b - Browse repository at this point
Copy the full SHA ccee33bView commit details -
Configuration menu - View commit details
-
Copy full SHA for e0e7f2c - Browse repository at this point
Copy the full SHA e0e7f2cView commit details -
Exit server on transform token exhaustion
When a server cannot acquire a transform token for an extended period of time, assume that it is malfunctioning and initiate a shutdown.
Configuration menu - View commit details
-
Copy full SHA for 8d85826 - Browse repository at this point
Copy the full SHA 8d85826View commit details
Commits on Jul 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a9936f0 - Browse repository at this point
Copy the full SHA a9936f0View commit details
Commits on Jul 7, 2023
-
Supply a basic retrier to remote cas writes
Worker loss can signal cascading failure and shutdown for execute-only peers. Ensure that a ReportResultStage seeing an SRE does not close the stage, and that there are basic retries for remote uploads.
Configuration menu - View commit details
-
Copy full SHA for f74f270 - Browse repository at this point
Copy the full SHA f74f270View commit details
Commits on Jul 12, 2023
-
Update buildfarm-indexer for upstream updates
Works with current redis-py-cluster 2.1.3
Configuration menu - View commit details
-
Copy full SHA for f7eb74a - Browse repository at this point
Copy the full SHA f7eb74aView commit details -
Configuration menu - View commit details
-
Copy full SHA for f893b5a - Browse repository at this point
Copy the full SHA f893b5aView commit details
Commits on Jul 15, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 70903df - Browse repository at this point
Copy the full SHA 70903dfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 68318c5 - Browse repository at this point
Copy the full SHA 68318c5View commit details
Commits on Jul 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 95719e5 - Browse repository at this point
Copy the full SHA 95719e5View commit details
Commits on Jul 26, 2023
-
Shut down prometheus collector thread on CFC stop
Prevents a hang on shutdown when redis is disconnected
Configuration menu - View commit details
-
Copy full SHA for abcd8fc - Browse repository at this point
Copy the full SHA abcd8fcView commit details
Commits on Jul 31, 2023
-
Output status code name on shard read error
Use the proper name for a status code as presented when the read will not be retried.
Configuration menu - View commit details
-
Copy full SHA for 9b4bd6f - Browse repository at this point
Copy the full SHA 9b4bd6fView commit details
Commits on Aug 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8710642 - Browse repository at this point
Copy the full SHA 8710642View commit details
Commits on Aug 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8315723 - Browse repository at this point
Copy the full SHA 8315723View commit details
Commits on Aug 8, 2023
-
chore(deps): bump Guava from 31.1-jre to 32.1.1-jre
Remediating https://nvd.nist.gov/vuln/detail/CVE-2023-2976
Configuration menu - View commit details
-
Copy full SHA for 77fee77 - Browse repository at this point
Copy the full SHA 77fee77View commit details -
Configuration menu - View commit details
-
Copy full SHA for b5754e4 - Browse repository at this point
Copy the full SHA b5754e4View commit details
Commits on Aug 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9e7e633 - Browse repository at this point
Copy the full SHA 9e7e633View commit details
Commits on Aug 11, 2023
-
Merge pull request buildfarm#1422 from keith/ks/update-platforms
Update platforms
Configuration menu - View commit details
-
Copy full SHA for ae907b5 - Browse repository at this point
Copy the full SHA ae907b5View commit details -
Add download rate metrics for buildfarm:worker (buildfarm#1418)
* Add download metrics for buildfarm:worker * Run formatter * remove static * change IO_METRIC prometheus counter to static
Configuration menu - View commit details
-
Copy full SHA for 18ae72e - Browse repository at this point
Copy the full SHA 18ae72eView commit details
Commits on Aug 31, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 1180a85 - Browse repository at this point
Copy the full SHA 1180a85View commit details -
Separate channel for write api (buildfarm#1424)
* Separate channel for write api * shutdown channel on termination
Configuration menu - View commit details
-
Copy full SHA for 8795c6e - Browse repository at this point
Copy the full SHA 8795c6eView commit details
Commits on Sep 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0abb176 - Browse repository at this point
Copy the full SHA 0abb176View commit details
Commits on Sep 20, 2023
-
Fix deadlock when handling Write request (buildfarm#1442)
* Fix deadlock by setting a timeout and removing the lock. * remove timeout as its not necessary * lint: delete unused import
Configuration menu - View commit details
-
Copy full SHA for 882e86f - Browse repository at this point
Copy the full SHA 882e86fView commit details -
Deliver RemoteCasWriter IOExceptions (buildfarm#1438)
Interactions with RemoteCasWriter which declare IOExceptions should throw them exclusively for failures.
Configuration menu - View commit details
-
Copy full SHA for 773341c - Browse repository at this point
Copy the full SHA 773341cView commit details -
JCenter is retired. Pick some mirrors from https://repo.maven.apache.org/maven2/.meta/repository-metadata.xml
Configuration menu - View commit details
-
Copy full SHA for 20d4ae5 - Browse repository at this point
Copy the full SHA 20d4ae5View commit details -
Configuration menu - View commit details
-
Copy full SHA for a7f1ac2 - Browse repository at this point
Copy the full SHA a7f1ac2View commit details
Commits on Sep 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for dfe9d3d - Browse repository at this point
Copy the full SHA dfe9d3dView commit details -
Permit --prometheus_port to override config
Specifying --prometheus_port for either server or worker will: Override the config value if delivered as int > 0, otherwise leave the config value alone. Since prometheusPort as configured <= 0 disables the server, this permits users to specify '0' to override the config with a disable switch. Updated quick_start docs to reflect this extra parameter.
Configuration menu - View commit details
-
Copy full SHA for ed15779 - Browse repository at this point
Copy the full SHA ed15779View commit details
Commits on Sep 22, 2023
-
[metrics] Emit operation_exit_code metric to track execution exit cod…
…es (buildfarm#1444) Co-authored-by: Trevor Hickey <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for fb7cbd8 - Browse repository at this point
Copy the full SHA fb7cbd8View commit details -
feat(redis): support rediss:// URIs for Redis-SSL
Support "rediss://" (extra 's', like https) to indicate Redis-SSL connections. For Redis client identifier, we use the `identifier` passed to RedisShardBackplane.
Configuration menu - View commit details
-
Copy full SHA for a6fe207 - Browse repository at this point
Copy the full SHA a6fe207View commit details -
Configuration menu - View commit details
-
Copy full SHA for 79eee49 - Browse repository at this point
Copy the full SHA 79eee49View commit details
Commits on Sep 23, 2023
-
Update rules_docker dependencies via injection
Specify and patch more recent rules_go and bazel_gazelle per upstream patch. Docker images work with recent HEAD releases of bazel as a result. Depends on buildfarm#1453 resolution to actually build //... Fixes buildfarm#1440
Configuration menu - View commit details
-
Copy full SHA for 3305669 - Browse repository at this point
Copy the full SHA 3305669View commit details
Commits on Sep 25, 2023
-
Treat '.' working_directory segment as current
Any '.' appearance as a segment should be considered to be the current directory in the search sequence of a working_directory path.
Configuration menu - View commit details
-
Copy full SHA for 7f86c47 - Browse repository at this point
Copy the full SHA 7f86c47View commit details -
Remove unused setExecuteResponseBuilder
Method setExecuteResponseBuilder is not called in OperationContext
Configuration menu - View commit details
-
Copy full SHA for 90439ca - Browse repository at this point
Copy the full SHA 90439caView commit details
Commits on Sep 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8cc247f - Browse repository at this point
Copy the full SHA 8cc247fView commit details -
Use integer ids for Sqlite bidirectional index
The cost in size for a single table bidirectional index is vast compared to the use of 3nf integer keys. Experimental estimates offer a decrease in file size of 90%.
Configuration menu - View commit details
-
Copy full SHA for f651cdb - Browse repository at this point
Copy the full SHA f651cdbView commit details
Commits on Sep 29, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9f93972 - Browse repository at this point
Copy the full SHA 9f93972View commit details
Commits on Oct 4, 2023
-
Manipulate worker set directly in RSB
Avoid dependency on subscriber to update state changes when removing workers. This prevents an NPE which will occur invariably when workers are allowably configured with subscribeToBackplane: false.
Configuration menu - View commit details
-
Copy full SHA for ec4b82c - Browse repository at this point
Copy the full SHA ec4b82cView commit details -
Remove publishTtlMetric option
The individual metric controls for ttl are not necessary either for performance or feature support. Use Files' attributes acquisition mechanism for modified time.
Configuration menu - View commit details
-
Copy full SHA for c48d600 - Browse repository at this point
Copy the full SHA c48d600View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2abad58 - Browse repository at this point
Copy the full SHA 2abad58View commit details -
Correct logging advisements for current Java
Java logging definitions must now match java.util.logging.config.file, update these specifications in our README.md
Configuration menu - View commit details
-
Copy full SHA for 10189d6 - Browse repository at this point
Copy the full SHA 10189d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0c30cb0 - Browse repository at this point
Copy the full SHA 0c30cb0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a0d8d6 - Browse repository at this point
Copy the full SHA 5a0d8d6View commit details -
Interrupt+Join operationQueuer/dispatchMonitor
Use interrupt to halt the OperationQueuer. Join on both operationQueuer and dispatchMonitor before instance stop return.
Configuration menu - View commit details
-
Copy full SHA for fa8dd6f - Browse repository at this point
Copy the full SHA fa8dd6fView commit details
Commits on Oct 5, 2023
-
Present operationNames by stage
Include Match and Report Result stages in output Record the active operationName occupying slots in each of the stages and present them with WorkerProfile Avoid several unnecessary casts with interfaces for operation slot stages.
Configuration menu - View commit details
-
Copy full SHA for 60093db - Browse repository at this point
Copy the full SHA 60093dbView commit details
Commits on Oct 6, 2023
-
Remove subscribeToBackplane, adjust failsafe op
A shard server is impractical without operation subscription, partition subscription confirmation between servers and workers. The failsafe execution is configuration that is likely not desired on workers. This change removes the failsafe behavior from workers via backplane config, and relegates the setting of failsafe boolean to server config. If the option is restored for workers, it can be added to worker configs so that configs may continue to be shared between workers and servers and retain independent addressability.
Configuration menu - View commit details
-
Copy full SHA for 9ff8e64 - Browse repository at this point
Copy the full SHA 9ff8e64View commit details -
Removing AWS/GCP Metrics and Admin controls
Internally driven metrics and scaling controls have low, if any, usage rates. Prometheus has largely succeeded independent publication of metrics, and externally driven scaling is the norm. These modules have been incomplete between cloud providers, and for the functional side of AWS, bind us to springboot. Removing them for the sake of reduced dependencies and complexity.
Configuration menu - View commit details
-
Copy full SHA for b21ab2e - Browse repository at this point
Copy the full SHA b21ab2eView commit details -
Remove unused setOnCancelHandler
Remove this unused OperationQueue feature which provides no invocations on any use.
Configuration menu - View commit details
-
Copy full SHA for f97f048 - Browse repository at this point
Copy the full SHA f97f048View commit details -
Configuration menu - View commit details
-
Copy full SHA for c2c1544 - Browse repository at this point
Copy the full SHA c2c1544View commit details
Commits on Oct 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 09015c9 - Browse repository at this point
Copy the full SHA 09015c9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1041b57 - Browse repository at this point
Copy the full SHA 1041b57View commit details
Commits on Oct 8, 2023
-
Revert "Use integer ids for Sqlite bidirectional index"
This reverts commit f651cdb.
Configuration menu - View commit details
-
Copy full SHA for 30412ad - Browse repository at this point
Copy the full SHA 30412adView commit details
Commits on Oct 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8379068 - Browse repository at this point
Copy the full SHA 8379068View commit details -
Cleanup matched logic in SWC listener
Continue the loop while we have *not* matched successfully and avoid a confusing inversion in getMatched()
Configuration menu - View commit details
-
Copy full SHA for fd20d13 - Browse repository at this point
Copy the full SHA fd20d13View commit details -
Refactor SWC matcher and clarify Nullable
Distinguish the valid/unique/propagating methods of entry listening.
Configuration menu - View commit details
-
Copy full SHA for 632fceb - Browse repository at this point
Copy the full SHA 632fcebView commit details -
Interrupt matchStage to induce prepare shutdown
The only signal to a waiting match that will halt its current listen loop for a valid unique operation is an interrupt.
Configuration menu - View commit details
-
Copy full SHA for 7385c74 - Browse repository at this point
Copy the full SHA 7385c74View commit details -
Specify example config with grpc target
Distinguish target param with GRPC type storage from FILESYSTEM definition
Configuration menu - View commit details
-
Copy full SHA for 79cf648 - Browse repository at this point
Copy the full SHA 79cf648View commit details -
Reinstate prior usage of LoggingMain for safe shutdown, with added release mechanism for interrupted processes. All invoked shutdowns are graceful, with vastly improved shutdown speed for empty workers waiting for pipeline stages.
Configuration menu - View commit details
-
Copy full SHA for d73628b - Browse repository at this point
Copy the full SHA d73628bView commit details
Commits on Oct 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6f88e34 - Browse repository at this point
Copy the full SHA 6f88e34View commit details
Commits on Oct 11, 2023
-
Tiny code cleanup
Configuration menu - View commit details
-
Copy full SHA for 81122e7 - Browse repository at this point
Copy the full SHA 81122e7View commit details
Commits on Oct 13, 2023
-
Log paths created on putDirectory
Will include operation root and inform directory cache effectiveness.
Configuration menu - View commit details
-
Copy full SHA for ad44854 - Browse repository at this point
Copy the full SHA ad44854View commit details
Commits on Oct 15, 2023
-
Permit regex realInputDirectories
Selecting realInputDirectories by regex permits flexible patterns that can yield drastic improvements in directory reuse for specialized deployments. runfiles in particular are hazardous expansions of nearly-execroot in the case of bazel. Care must be taken to match directories exclusively. The entire input tree is traversed for matches against expanded paths under the root, to allow for nested selection. Each match thus costs the number of input directories. Counterintuitively, OutputFiles are augmented to avoid the recursive check for OutputDirectories which only applies to actual reported results, resulting in a path match when creating the exec root. Regex style is java.util.Pattern, and must match the full input directory.
Configuration menu - View commit details
-
Copy full SHA for b31ffed - Browse repository at this point
Copy the full SHA b31ffedView commit details -
Log execPath rather than the cache dir path
This will include the path to the missed directory and the operation which required it.
Configuration menu - View commit details
-
Copy full SHA for 1dec684 - Browse repository at this point
Copy the full SHA 1dec684View commit details -
Shore up OutputDirectory for silence on duplicates
Prevent adding duplicate realInputDirectories matches
Configuration menu - View commit details
-
Copy full SHA for 6af857a - Browse repository at this point
Copy the full SHA 6af857aView commit details -
Trigger realInputDirectories to have empty files
Ensure that the last leg of the execution presents a directory, rather than the parent, per OutputDirectory's stamping.
Configuration menu - View commit details
-
Copy full SHA for 71a928c - Browse repository at this point
Copy the full SHA 71a928cView commit details -
Configuration menu - View commit details
-
Copy full SHA for f8017bd - Browse repository at this point
Copy the full SHA f8017bdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d88e54 - Browse repository at this point
Copy the full SHA 5d88e54View commit details -
Configuration menu - View commit details
-
Copy full SHA for 21448c3 - Browse repository at this point
Copy the full SHA 21448c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 461cc5a - Browse repository at this point
Copy the full SHA 461cc5aView commit details -
feat: support --redis_uri command line option
Support a `--redis_uri` command line option for start-up.
Configuration menu - View commit details
-
Copy full SHA for b74531c - Browse repository at this point
Copy the full SHA b74531cView commit details -
docs(configuration): document the --redis_uri command line options
also fixed some spelling typos.
Configuration menu - View commit details
-
Copy full SHA for d860b27 - Browse repository at this point
Copy the full SHA d860b27View commit details -
Configuration menu - View commit details
-
Copy full SHA for 10bf139 - Browse repository at this point
Copy the full SHA 10bf139View commit details -
chore: bump rules_jvm_external
Bumping 4.2 -> 5.3
Configuration menu - View commit details
-
Copy full SHA for 9d4c86c - Browse repository at this point
Copy the full SHA 9d4c86cView commit details -
Bump fro 0.0.6 -> 0.0.9
Configuration menu - View commit details
-
Copy full SHA for 5bc4564 - Browse repository at this point
Copy the full SHA 5bc4564View commit details
Commits on Oct 17, 2023
-
Configuration menu - View commit details
-
Copy full SHA for edf2211 - Browse repository at this point
Copy the full SHA edf2211View commit details
Commits on Oct 24, 2023
-
build: override grpc dependencies with our dependencies
Don't get transitive grpc dependencies, use the ones from our `maven_install(...)`
Configuration menu - View commit details
-
Copy full SHA for 97e3b90 - Browse repository at this point
Copy the full SHA 97e3b90View commit details -
Configuration menu - View commit details
-
Copy full SHA for 96f239d - Browse repository at this point
Copy the full SHA 96f239dView commit details -
Configuration menu - View commit details
-
Copy full SHA for af3f34e - Browse repository at this point
Copy the full SHA af3f34eView commit details -
feat: add Proto reflection service to shard worker
To aid connection troubleshooting
Configuration menu - View commit details
-
Copy full SHA for 380f8a1 - Browse repository at this point
Copy the full SHA 380f8a1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e7979d - Browse repository at this point
Copy the full SHA 7e7979dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f9d01f - Browse repository at this point
Copy the full SHA 1f9d01fView commit details -
Bug: Fix Blocked thread in WriteStreamObserver Caused by CASFile Write (
buildfarm#1486) * Add unit test * Signal Write on complete
Configuration menu - View commit details
-
Copy full SHA for 578589f - Browse repository at this point
Copy the full SHA 578589fView commit details -
Pin the Java toolchain to
remotejdk_17
(buildfarm#1509)Closes buildfarm#1508 Cleanups: - remove the unused `ubuntu-bionic` base image - replace `ubuntu-jammy:jammy-java11-gcc` with `ubuntu-mantic:mantic-java17-gcc` - replace `amazoncorretto:19` with `ubuntu-mantic:mantic-java17-gcc` - swap inverted log file names in a file
Configuration menu - View commit details
-
Copy full SHA for dfa5937 - Browse repository at this point
Copy the full SHA dfa5937View commit details -
Configuration menu - View commit details
-
Copy full SHA for f6459d1 - Browse repository at this point
Copy the full SHA f6459d1View commit details
Commits on Oct 25, 2023
-
Support OutputPaths in OutputDirectory
Specifying any number of OutputPaths will ignore OutputFiles (consistent with uploads). Where an OutputPath specifies an output directory, the action must be able to create the directory itself.
Configuration menu - View commit details
-
Copy full SHA for 018e177 - Browse repository at this point
Copy the full SHA 018e177View commit details
Commits on Oct 26, 2023
-
Permit Absolute Symlink Targets with configuration
Partial specification of the absolute symlink response per REAPI. Remaining work will be in output identification.
Configuration menu - View commit details
-
Copy full SHA for 8b37013 - Browse repository at this point
Copy the full SHA 8b37013View commit details
Commits on Oct 29, 2023
-
chore: update bazel to 6.4.0 (buildfarm#1513)
Trying to get more info on the Lombok stamping issue on Windows CI. See also bazelbuild/bazel#10363 and bazelbuild/bazel#18185
Configuration menu - View commit details
-
Copy full SHA for df9ce1d - Browse repository at this point
Copy the full SHA df9ce1dView commit details
Commits on Oct 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for bd740c9 - Browse repository at this point
Copy the full SHA bd740c9View commit details -
Create SymlinkNode outputs during upload (buildfarm#1515)
Default disabled, available with createSymlinkOutputs option in Worker config.
Configuration menu - View commit details
-
Copy full SHA for 2a61f77 - Browse repository at this point
Copy the full SHA 2a61f77View commit details
Commits on Oct 31, 2023
-
feat: Implement CAS lease extension (buildfarm#1455)
Problem Enabling the findMissingBlobsViaBackplane flag in BuildfarmServer eliminates the need for the BuildfarmWorker's fmb API call. This BuildfarmWorker:fmb call was also responsible for tracking CAS entry access. As result, our CAS cache eviction strategy shifted from LRU to FIFO. When the findMissingBlobsViaBackplane flag is enabled, the buildfarm relies on the backplane as the definitive source for CAS availability. Since we don't update CAS expiry on each access, the backplane will independently expire CAS entries based on the specified cas_expire duration, even if they are actively being read. Solution Updated bfServer:fmb call to perform non-blocking fmb calls to workers, allowing these workers to record access for the relevant CAS entries. Extended expiry duration for available CAS entries in the backplane on each fmb call. With these changes, we can utilize Bazel's experimental_remote_cache_lease_extension and experimental_remote_cache_ttl flags for incremental builds. Closes buildfarm#1428
Configuration menu - View commit details
-
Copy full SHA for 76c2657 - Browse repository at this point
Copy the full SHA 76c2657View commit details -
Bump org.json:json from 20230227 to 20231013 in /admin/main (buildfar…
…m#1516) Bumps [org.json:json](https://github.com/douglascrockford/JSON-java) from 20230227 to 20231013. - [Release notes](https://github.com/douglascrockford/JSON-java/releases) - [Changelog](https://github.com/stleary/JSON-java/blob/master/docs/RELEASES.md) - [Commits](https://github.com/douglascrockford/JSON-java/commits) --- updated-dependencies: - dependency-name: org.json:json dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for cfa2e18 - Browse repository at this point
Copy the full SHA cfa2e18View commit details
Commits on Nov 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ff00c8f - Browse repository at this point
Copy the full SHA ff00c8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for afb0603 - Browse repository at this point
Copy the full SHA afb0603View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9b5ec43 - Browse repository at this point
Copy the full SHA 9b5ec43View commit details -
Configuration menu - View commit details
-
Copy full SHA for f9ef75a - Browse repository at this point
Copy the full SHA f9ef75aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 20512f6 - Browse repository at this point
Copy the full SHA 20512f6View commit details -
Read through external with query THROUGH=true
Specifying a correlated invocation id with a uri containing a THROUGH=true query param will cause the CFC to read a blob through an external input stream, populating locally along the way. This permits client-based replication of blobs, and can enable N+1 replication and traffic balancing for reads.
Configuration menu - View commit details
-
Copy full SHA for 654032e - Browse repository at this point
Copy the full SHA 654032eView commit details -
Option to run the worker with a cmdline specification for its gRPC server port.
Configuration menu - View commit details
-
Copy full SHA for b4359c5 - Browse repository at this point
Copy the full SHA b4359c5View commit details -
Restore worker --root cmdline specification
Root cmdline specification has been broken since the config change of v2.
Configuration menu - View commit details
-
Copy full SHA for 5195809 - Browse repository at this point
Copy the full SHA 5195809View commit details -
Make bf-executor small blob names consistent
Remove the size identification for small blobs when uploading with bf-executor.
Configuration menu - View commit details
-
Copy full SHA for 938c789 - Browse repository at this point
Copy the full SHA 938c789View commit details
Commits on Nov 2, 2023
-
Configured output size operation failure
Permit installations to control the failure process for operations which produce outputs larger than the maxEntrySizeBytes. A default value of false retains the existing behavior which appears transient and blacklists the executed action key. When enabled, the action will fail under an invalid violation that indicates user error.
Configuration menu - View commit details
-
Copy full SHA for 87face1 - Browse repository at this point
Copy the full SHA 87face1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 58faec9 - Browse repository at this point
Copy the full SHA 58faec9View commit details -
Update zstd-jni for latest version
There's been a few releases of it by now and this pulls the latest. For buildfarm, notable changes included performance enhancments during decompression. See: https://github.com/facebook/zstd/releases/tag/v1.5.5
Configuration menu - View commit details
-
Copy full SHA for cf6fc58 - Browse repository at this point
Copy the full SHA cf6fc58View commit details
Commits on Nov 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6bc70e1 - Browse repository at this point
Copy the full SHA 6bc70e1View commit details -
Configuration menu - View commit details
-
Copy full SHA for b226725 - Browse repository at this point
Copy the full SHA b226725View commit details
Commits on Nov 4, 2023
-
Update for further docs related to storage+type functionality Remove outdated Operation Queue worker definitions
Configuration menu - View commit details
-
Copy full SHA for 751ac90 - Browse repository at this point
Copy the full SHA 751ac90View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2bf3eae - Browse repository at this point
Copy the full SHA 2bf3eaeView commit details -
Configuration menu - View commit details
-
Copy full SHA for b6bddff - Browse repository at this point
Copy the full SHA b6bddffView commit details
Commits on Nov 6, 2023
-
Check for context cancelled before responding to error (buildfarm#1526)
When a write fails because the write was already cancelled before due to something like deadline exceeded, we get an unknown error. The exception comes from here and when it gets to errorResponse(), it only checks if status code is cancelled. In this case the status code is unknown, so we need to check if context is cancelled to prevent responseObserver from being invoked The code change adds checking if context is cancelled and a unit test testing when the exception has context cancelled.
Configuration menu - View commit details
-
Copy full SHA for c490925 - Browse repository at this point
Copy the full SHA c490925View commit details -
chore(deps): bump com.google.errorprone:error-prone
Release notes: https://github.com/google/error-prone/releases/tag/v2.22.0
Configuration menu - View commit details
-
Copy full SHA for 2a51c31 - Browse repository at this point
Copy the full SHA 2a51c31View commit details
Commits on Nov 8, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7ea1a9f - Browse repository at this point
Copy the full SHA 7ea1a9fView commit details
Commits on Nov 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a4822c1 - Browse repository at this point
Copy the full SHA a4822c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for f1ea9b5 - Browse repository at this point
Copy the full SHA f1ea9b5View commit details -
Configuration menu - View commit details
-
Copy full SHA for ccf763d - Browse repository at this point
Copy the full SHA ccf763dView commit details -
Configuration menu - View commit details
-
Copy full SHA for b7f5661 - Browse repository at this point
Copy the full SHA b7f5661View commit details -
Configuration menu - View commit details
-
Copy full SHA for 72b40ae - Browse repository at this point
Copy the full SHA 72b40aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 14c759b - Browse repository at this point
Copy the full SHA 14c759bView commit details -
Configuration menu - View commit details
-
Copy full SHA for ca9bb92 - Browse repository at this point
Copy the full SHA ca9bb92View commit details -
[execution] allow tmpfs and cgroups enforcement
tmpfs Previously we required bazel clients to opt-in with an exec_property. Now buildfarm has the ability to enforce tmpfs usage as part of deployment configuration. See: alwaysUseTmpFs: true cgroups cgroups was previously enabled via limitGlobalExecution. However, there was no way to opt-out of cgroups and opt-in to other restrictions. limitGlobalExecution is still required for accessing restrictions, but it will no longer guarantee cgroups is used. For that, deployments must set: See: alwaysUseCgroups: true Additional context We may also want to experiment with sandbox, but not cgroups in our deployment. There is currently no way to do this because enabling sandbox also requires enabling limitGlobalExecution, but doing so enables cgroups. By making these settings more granular we are able opt into and enforce particular execution wrappers.
Configuration menu - View commit details
-
Copy full SHA for 10e68c4 - Browse repository at this point
Copy the full SHA 10e68c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 35883a4 - Browse repository at this point
Copy the full SHA 35883a4View commit details -
Refer to new camelized DMS fields. Expand predefined dynamic execution property name matches.
Configuration menu - View commit details
-
Copy full SHA for 9d80f4e - Browse repository at this point
Copy the full SHA 9d80f4eView commit details
Commits on Nov 10, 2023
-
Implement custom label header support for Grpc metrics interceptor (b…
…uildfarm#1530) Add an option to provide a list of custom label headers to add to metrics.
Configuration menu - View commit details
-
Copy full SHA for aac33b6 - Browse repository at this point
Copy the full SHA aac33b6View commit details
Commits on Nov 11, 2023
-
Specify direct guava dependency usage (buildfarm#1538)
Testing with bazel HEAD using jdk21 compilation has revealed new direct dependencies on guava.
Configuration menu - View commit details
-
Copy full SHA for f9882f7 - Browse repository at this point
Copy the full SHA f9882f7View commit details -
Update lombok dependency for jdk21 (buildfarm#1540)
Annotations under lombok were fixed for jdk21 in 1.18.28, update to current.
Configuration menu - View commit details
-
Copy full SHA for 69e0248 - Browse repository at this point
Copy the full SHA 69e0248View commit details -
Reorganize DequeueMatchEvaluator (buildfarm#1537)
Remove acceptEverything DequeueMatchSetting Place worker name in workerProvisions Only enable allowUnmatched effects on key mismatch Only acquire resources after asserting compatibility Update documentation to match changes
Configuration menu - View commit details
-
Copy full SHA for 339aa13 - Browse repository at this point
Copy the full SHA 339aa13View commit details -
Upgrade com_google_protobuf for jvm compatibility (buildfarm#1539)
Correct deprecated AccessController usage warning Requires a newer bazel than 6.4.0 for macos to choose unix toolchain with C++ std=c++14 specification for protobuf->absl dependency.
Configuration menu - View commit details
-
Copy full SHA for 025305a - Browse repository at this point
Copy the full SHA 025305aView commit details -
Create buildfarm-worker-base-build-and-deploy.yml (buildfarm#1534)
Create a github workflow to build base buildfarm worker image.
Configuration menu - View commit details
-
Copy full SHA for f720909 - Browse repository at this point
Copy the full SHA f720909View commit details -
Configuration menu - View commit details
-
Copy full SHA for b7daba3 - Browse repository at this point
Copy the full SHA b7daba3View commit details -
Configuration menu - View commit details
-
Copy full SHA for dcff4f0 - Browse repository at this point
Copy the full SHA dcff4f0View commit details
Commits on Nov 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 52318f8 - Browse repository at this point
Copy the full SHA 52318f8View commit details
Commits on Nov 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for e343393 - Browse repository at this point
Copy the full SHA e343393View commit details -
Configuration menu - View commit details
-
Copy full SHA for dae7f78 - Browse repository at this point
Copy the full SHA dae7f78View commit details -
Configuration menu - View commit details
-
Copy full SHA for b01889d - Browse repository at this point
Copy the full SHA b01889dView commit details -
Check for "cores" exec property as min-cores match (buildfarm#1548)
The execution platform property "cores" is detailed in documentation as specifying "min-cores" and "max-cores". Match this definition and prevent "cores" from being evaluated as a strict match with the worker provision properties (with likely rejection).
Configuration menu - View commit details
-
Copy full SHA for dcee798 - Browse repository at this point
Copy the full SHA dcee798View commit details
Commits on Nov 19, 2023
-
Consider output_* as relative to WD (buildfarm#1550)
Per the REAPI spec: `The paths are relative to the working directory of the action execution.` Prefix the WorkingDirectory to paths used as OutputDirectory parameters, and verify that these are present in the layout of the directory for use.
Configuration menu - View commit details
-
Copy full SHA for 221eae9 - Browse repository at this point
Copy the full SHA 221eae9View commit details
Commits on Nov 20, 2023
-
Implement Persistent Workers as an execution path (buildfarm#1260)
Followup to buildfarm#1195 Add a new execution pathway in worker/Executor.java to use persistent workers via PersistentExecutor, like DockerExecutor. Mostly unchanged from the form we used to experiment back at Twitter, but now with tests. Co-authored-by: Shane Delmore [email protected]
Configuration menu - View commit details
-
Copy full SHA for 91587e7 - Browse repository at this point
Copy the full SHA 91587e7View commit details
Commits on Nov 22, 2023
-
Locate Output Paths relative to WorkingDirectory (buildfarm#1553)
* Locate Output Paths relative to WorkingDirectory Required as a corollary to OutputDirectory changes to consider outputs as relative to working directory. * Windows builds emit relativize paths with native separators
Configuration menu - View commit details
-
Copy full SHA for a56b161 - Browse repository at this point
Copy the full SHA a56b161View commit details -
Remove incorrect external resolve of WD on upload (buildfarm#1554)
Previous patch included a change in actionRoot parameter, expecting it to prefer the working directory rooted path to discover outputs. Might want to reapply this later, but for now leave the resolution in uploadOutputs.
Configuration menu - View commit details
-
Copy full SHA for 53e1fba - Browse repository at this point
Copy the full SHA 53e1fbaView commit details
Commits on Nov 30, 2023
-
Instance cleanups (buildfarm#1555)
* Prevent multiple fetches of QueuedOperation Propagate the Tree in OperationContext for use during the persistent workers clause in Executor * Correct WSO and StubWriteOutputStream completion onCompleted should always be called on open requests when StubWriteOutputStreams are closed, even when completed early by the server. onCompleted must be delivered to responseObserver when onCompleted is invoked, lest a no-request write stream be left hanging to DEADLINE_EXCEEDED. * Explicit reset on WriteOffset 0 and blob write Avoid unnecessary queryWriteStatus requests when a WriteRequest appears with write offset 0 in WSO, and reset the stream initially for internal ServerInstance blob uploads.
Configuration menu - View commit details
-
Copy full SHA for dd5c87b - Browse repository at this point
Copy the full SHA dd5c87bView commit details -
Configuration menu - View commit details
-
Copy full SHA for d249393 - Browse repository at this point
Copy the full SHA d249393View commit details
Commits on Dec 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a7ef693 - Browse repository at this point
Copy the full SHA a7ef693View commit details
Commits on Dec 5, 2023
-
add github action to package and publish the helm chart as a released…
… artifact (buildfarm#1556) * bundle with helm publish release with gh cli * add a basic doc for the helm chart
Configuration menu - View commit details
-
Copy full SHA for a06b095 - Browse repository at this point
Copy the full SHA a06b095View commit details
Commits on Dec 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 68182ec - Browse repository at this point
Copy the full SHA 68182ecView commit details
Commits on Dec 12, 2023
-
Write onNext requires onCompleted to follow (buildfarm#1565)
For reasons passing understanding, a WriteResponse is not delivered to a client solely from onNext to be received by a client called via bsStub. onCompleted must follow the onNext for a timely delivery of the response, particularly when it occurs before an onCompleted from the client. This does not seem to affect the bazel client, which could indicate a difference in behavior between grpc versions, or simply that it manages to complete its upload completely ignorant of the early return status. More investigation is required. This will fix hanging builds which occur with exec-only workers failing to complete uploads to shard peers.
Configuration menu - View commit details
-
Copy full SHA for e26a000 - Browse repository at this point
Copy the full SHA e26a000View commit details -
chore: update maven dependencies (buildfarm#1434)
* chore(deps): bump com.amazonaws:aws-java-sdk-* Update to 1.12.544 * chore(deps): bump org.redisson:redisson Update to 3.23.4 * chore(deps): bump org.threeten:threetenbp Update to 1.6.8 * chore(deps): bump org.snakeyaml:snakeyaml Update to 2.2 * chore(deps): bump com.github.docker-java:docker-java * chore(deps): bump com.github.jnr:* Bumping all packages in this groupId to the latest. * chore(deps): bump com.github.serceman:jnr-fuse * chore(deps): bump com.github.oshi:oshi-core * chore(deps): bump com.google.auth:* Oauth libraries to the latest. * chore(deps): bump com.google.code.findbugs:jsr305 * chore(deps): bump com.google.code.gson:gson * chore(deps): bump com.google.j2objc:j2objc-annotations * chore(deps): bump com.google.jimfs:jimfs * chore(deps): bump org.slf4j.slf4j-simple * chore(deps): bump com.jayway.jsonpath:json-path * chore(deps): bump io.netty:* * chore(deps): bump io.prometheus:* * chore(deps): bump junit:junit * chore(deps): bump org.apache.commons:commons-compress * chore(deps): bump org.apache.commons:commons-pool2 * chore(deps): bump org.apache.commons:commons-lang3 * chore(deps): bump commons-io:commons-io * chore(deps): bump me.dinowernli:java-grpc-prometheus * chore(deps): bump org.checkerframework:checker-qual * chore(deps): bump com.google.truth:truth * chore(deps): bump org.openjdk.jmh:*
Configuration menu - View commit details
-
Copy full SHA for 859abb6 - Browse repository at this point
Copy the full SHA 859abb6View commit details -
build: support compiling protobuf on macOS (buildfarm#1563)
MacOS needs extra args to convince it to support C++14.
Configuration menu - View commit details
-
Copy full SHA for 27194c7 - Browse repository at this point
Copy the full SHA 27194c7View commit details -
tests: bump bazelversion for integration tests (buildfarm#1566)
Bumping 5.2.0 -> 6.4.0
Configuration menu - View commit details
-
Copy full SHA for 1046e97 - Browse repository at this point
Copy the full SHA 1046e97View commit details
Commits on Dec 13, 2023
-
[tests] add unit test for local resources (buildfarm#1558)
Add a unit test related to handling of local resources.
Configuration menu - View commit details
-
Copy full SHA for 8d6e93f - Browse repository at this point
Copy the full SHA 8d6e93fView commit details -
refactor: swap HealthStatusManager (buildfarm#1568)
Swapping to the recommended class that isn't deprecated. Also, remove unnecessary String.format(...) with no format args.
Configuration menu - View commit details
-
Copy full SHA for fe2eba2 - Browse repository at this point
Copy the full SHA fe2eba2View commit details
Commits on Dec 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 284845a - Browse repository at this point
Copy the full SHA 284845aView commit details -
feat: Redis password from file (buildfarm#1569)
* feat(config): read Redis password from Redis URI or redis password file * tests(common): add a test for build.buildfarm.common.config.Backplane * docs(configuration): document redisPasswordFile Documenting new configuration parameter and the precedence of each password option.
Configuration menu - View commit details
-
Copy full SHA for 8950953 - Browse repository at this point
Copy the full SHA 8950953View commit details -
docs: update AUTHORS and CONTRIBUTORS (buildfarm#1572)
Adding myself and my copyright holder to `CONTRIBUTORS` and `AUTHORS`, respectively.
Configuration menu - View commit details
-
Copy full SHA for a4551f0 - Browse repository at this point
Copy the full SHA a4551f0View commit details -
Identify Graceful Shutdown errors with severe (buildfarm#1574)
Ensure that the log reflects these as errors, not just info
Configuration menu - View commit details
-
Copy full SHA for f9140c4 - Browse repository at this point
Copy the full SHA f9140c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for f76893e - Browse repository at this point
Copy the full SHA f76893eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1fa3c43 - Browse repository at this point
Copy the full SHA 1fa3c43View commit details -
Configuration menu - View commit details
-
Copy full SHA for cf3ac77 - Browse repository at this point
Copy the full SHA cf3ac77View commit details -
Configuration menu - View commit details
-
Copy full SHA for ce31446 - Browse repository at this point
Copy the full SHA ce31446View commit details -
Determine PipelineStage exception severity (buildfarm#1579)
Select pipeline stage terminations based on exception type. InterruptedExceptions are terminable. Errors are uncaught and will terminate the stage. All others are logged with the pipeline continuing.
Configuration menu - View commit details
-
Copy full SHA for 2a6f68c - Browse repository at this point
Copy the full SHA 2a6f68cView commit details -
Authored sandbox asNobody behavior (buildfarm#1580)
Describe a boolean authored to supply the as-nobody wrapper published with buildfarm deployments that should serve as a quick mechanism for any install to use non-buildfarm (typically root) uids for actions.
Configuration menu - View commit details
-
Copy full SHA for a0ec481 - Browse repository at this point
Copy the full SHA a0ec481View commit details -
Provide Additional sandbox write paths in config (buildfarm#1581)
Deployments may specify the paths that should be writable in sandbox
Configuration menu - View commit details
-
Copy full SHA for 9156123 - Browse repository at this point
Copy the full SHA 9156123View commit details
Commits on Dec 18, 2023
-
Declare stat block information for FuseCAS (buildfarm#1582)
Useful so that a `du` and other block related tools work on the mounted directory.
Configuration menu - View commit details
-
Copy full SHA for b48032b - Browse repository at this point
Copy the full SHA b48032bView commit details -
Try a new version of jekyll (buildfarm#1583)
Current version is failing with a gem bundler error
Configuration menu - View commit details
-
Copy full SHA for 2097ef9 - Browse repository at this point
Copy the full SHA 2097ef9View commit details
Commits on Dec 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for d4de791 - Browse repository at this point
Copy the full SHA d4de791View commit details -
Remove rules k8s (buildfarm#1587)
* build: remove rules_k8s The repo was archived May 12, 2023. * chore: remove unused k8s templates Please use the helm chart instead. * chore: Tiltfile updates to use helm chart instead
Configuration menu - View commit details
-
Copy full SHA for f320a81 - Browse repository at this point
Copy the full SHA f320a81View commit details -
chore: bump rules_license to 0.0.7 (buildfarm#1585)
Updating rules_license https://github.com/bazelbuild/rules_license/releases/tag/0.0.7
Configuration menu - View commit details
-
Copy full SHA for 2870a3f - Browse repository at this point
Copy the full SHA 2870a3fView commit details -
Bump rules_go and gazelle (buildfarm#1584)
* deps: bump rules_go Updating to 0.43.0 https://github.com/bazelbuild/rules_go/releases/tag/v0.43.0 * deps: bump gazelle Updating to 0.34.0 https://github.com/bazelbuild/bazel-gazelle/releases/tag/v0.34.0
Configuration menu - View commit details
-
Copy full SHA for 1b52ac0 - Browse repository at this point
Copy the full SHA 1b52ac0View commit details
Commits on Jan 2, 2024
-
[CI] skip server/worker audit on mac (buildfarm#1592)
* do not audit server/worker jars on mac Avoid python dependencies on mac unit test CI * Update presubmit.yml comment reference to underlying issue --------- Co-authored-by: George Gensure <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 78b001c - Browse repository at this point
Copy the full SHA 78b001cView commit details -
Helm Chart: latest image tags not v-prefixed (buildfarm#1591)
* latest images with versions not v-prefixed * stage 0.2.0 of the Helm chart
Configuration menu - View commit details
-
Copy full SHA for b5425e0 - Browse repository at this point
Copy the full SHA b5425e0View commit details -
Update helm values to use safe defaults (buildfarm#1597)
Removed values which will likely cause problems for execution and CFC saturation from helm chart: inputFetchStage_width and execute_stage_width both can be discovered from available processors maxSizeBytes for filesystem cas is automatically 90% of underlying file storage, down from a value 10x the actual bytes on storage requested below. path, names, and configuration for root, filesystem, and publicName can all be defaulted/derived safely.
Configuration menu - View commit details
-
Copy full SHA for 41b4494 - Browse repository at this point
Copy the full SHA 41b4494View commit details
Commits on Jan 3, 2024
-
Properly balance over nodes, not slot ranges (buildfarm#1598)
Slot ranges must not associate multiple times on a single node for use with balanced queues designed to be load balanced.
Configuration menu - View commit details
-
Copy full SHA for 088b8e1 - Browse repository at this point
Copy the full SHA 088b8e1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6b5db62 - Browse repository at this point
Copy the full SHA 6b5db62View commit details -
Use integer ids for Sqlite bidirectional index (buildfarm#1599)
The cost in size for a single table bidirectional index is vast compared to the use of 3nf integer keys. Experimental estimates offer a decrease in file size of 90%.
Configuration menu - View commit details
-
Copy full SHA for 413021d - Browse repository at this point
Copy the full SHA 413021dView commit details -
Write cleanups (buildfarm#1600)
* Guard against writeObserver null race * Avoid cancellation log for StubWriteOutputStream Cancels will happen for all server->worker uploads on context cancels initiated by clients, and are normal behaviors. * Guarantee null write response for onCompleted Avoid a complaint by gRPC that a client-streaming request was completed without a response * Reset remote CAS write on initial Prevents the StubWriteOutputStream from issuing an unnecessary initial queryWriteStatus.
Configuration menu - View commit details
-
Copy full SHA for 16b3aea - Browse repository at this point
Copy the full SHA 16b3aeaView commit details -
fix: format without placeholders (buildfarm#1586)
These instances of `format(...)` do not have placeholders and there's nothing to format.
Configuration menu - View commit details
-
Copy full SHA for 51608f7 - Browse repository at this point
Copy the full SHA 51608f7View commit details -
chore: Update proto file styling (buildfarm#1594)
* chore: Update proto file styling * fix path * move protp styling to file * add new line at eof
Configuration menu - View commit details
-
Copy full SHA for 74b1f56 - Browse repository at this point
Copy the full SHA 74b1f56View commit details -
fix: Periodically Refresh Active Storage Workers With StartTime (buil…
…dfarm#1549) * fix: Periodically Refresh Active Storage Workers With startTime
Configuration menu - View commit details
-
Copy full SHA for e51f1e1 - Browse repository at this point
Copy the full SHA e51f1e1View commit details
Commits on Jan 4, 2024
-
Revert "Use integer ids for Sqlite bidirectional index (buildfarm#1599)…
…" (buildfarm#1603) This reverts commit 413021d.
Configuration menu - View commit details
-
Copy full SHA for c79b213 - Browse repository at this point
Copy the full SHA c79b213View commit details
Commits on Jan 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 044597e - Browse repository at this point
Copy the full SHA 044597eView commit details
Commits on Jan 8, 2024
-
Decode nodeId with jedis util SafeEncoder (buildfarm#1607)
Node name strings provided via `cluster slots` will be byte arrays that require decoding. Use the inbuilt SafeEncoder from jedis which is used to decode all other strings.
Configuration menu - View commit details
-
Copy full SHA for 74316e7 - Browse repository at this point
Copy the full SHA 74316e7View commit details
Commits on Jan 9, 2024
-
build: start adopting bzlmod (buildfarm#1564)
* build: start adopting bzlmod Only four bazel dependencies were found in the existing bzlmod registry (https://registry.bazel.build/) * build: swap io_bazel_rules_go for bzlmod * build: swap gazelle for bzlmod * tests: support bzlmod I don't know why. But it works. * build: leave breadcrumbs for bzlmod migration * build(chore): MODULE.bazel.lock * build: swap buildtools for buildifier_prebuilt There are conflicts with go tooling between buildtools and protobuf.
Configuration menu - View commit details
-
Copy full SHA for b62a4ce - Browse repository at this point
Copy the full SHA b62a4ceView commit details
Commits on Jan 10, 2024
-
fix(coverage): coverage numbers are not accurate (buildfarm#1609)
The awk was pulling out the denominator of the metric, not the percent. Adjust the field. Before: ``` current line coverage: 1625% current function coverage: 340% ``` after: ``` current line coverage: 42% current function coverage: 51% ```
Configuration menu - View commit details
-
Copy full SHA for 373cb21 - Browse repository at this point
Copy the full SHA 373cb21View commit details -
Add
helm lint
CI job. Split tag/release for the Helm chart from the…… entire repo with tags: `helm/X.Y.Z-b1` (buildfarm#1602) * add helm chart linting stage, bundle chart on helm/* tags * fix triggers * try try again * always lint before bundling * extract the helm chart version from the git tag ref * fix name * tickle the beast * too much stack overflow * better names * that's output * gussy up readme * simplify * stage 0.2.2 * put extraVolumeMounts under .Values.shardWorker * omit defaults * leave out emacs gitignore * wrong example
Configuration menu - View commit details
-
Copy full SHA for b40c14b - Browse repository at this point
Copy the full SHA b40c14bView commit details
Commits on Jan 12, 2024
-
Publish storage worker and execute worker pool size in prometheus (bu…
…ildfarm#1606) * Publish storage worker and execute worker pool size in prometheus * run formatter * add doc --------- Co-authored-by: Yuriy Belenitsky <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for d155c0b - Browse repository at this point
Copy the full SHA d155c0bView commit details
Commits on Jan 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 646d956 - Browse repository at this point
Copy the full SHA 646d956View commit details -
Provide hashedName in BackplaneStatus Queue Name (buildfarm#1616)
Avoid stripping the existingHash, used to calculate the slot with suffix modifiers for queue balancing. Client presentation may also move to presenting each balanced queue name, removing the coordinated calculation on the client. The name could only have been used by a client prior for name presentation or determination of queue names in redis from slot arrangement.
Configuration menu - View commit details
-
Copy full SHA for ea35e56 - Browse repository at this point
Copy the full SHA ea35e56View commit details
Commits on Jan 25, 2024
-
set expire and drop invocationId (buildfarm#1589)
* set expire and drop invocationId * fix format * patch configuration doc * fix typo * re-run ci use luxe's patch * set expire when every active operation insert * fix return code * fix ci if statement --------- Co-authored-by: wangpengfei.pfwang <[email protected]> Co-authored-by: George Gensure <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for fe2c51c - Browse repository at this point
Copy the full SHA fe2c51cView commit details -
Add OSSF scorecard (buildfarm#1618)
* feat: add OSSF Scorecards workflow Adding OSSF Scorecards workflow as github action. It runs periodially. Output goes into Code Scanning alerts of GitHub. * docs(README): add some badges - OSSF Scorecard - License (from GitHub) - latest Release (from GitHub)
Configuration menu - View commit details
-
Copy full SHA for b7980a0 - Browse repository at this point
Copy the full SHA b7980a0View commit details -
chore: remove rules_oss_audit (buildfarm#1617)
Remove rules_oss_audit and accompanying documentation
Configuration menu - View commit details
-
Copy full SHA for 8a7873b - Browse repository at this point
Copy the full SHA 8a7873bView commit details
Commits on Feb 4, 2024
-
Configuration menu - View commit details
-
Copy full SHA for bb60196 - Browse repository at this point
Copy the full SHA bb60196View commit details
Commits on Feb 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8a3abb6 - Browse repository at this point
Copy the full SHA 8a3abb6View commit details
Commits on Feb 15, 2024
-
fix template bugs with with (buildfarm#1631)
* fix template bugs with with * stage chart v0.2.3
Configuration menu - View commit details
-
Copy full SHA for 60b3890 - Browse repository at this point
Copy the full SHA 60b3890View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1eb0528 - Browse repository at this point
Copy the full SHA 1eb0528View commit details
Commits on Feb 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cab70f2 - Browse repository at this point
Copy the full SHA cab70f2View commit details
Commits on Feb 19, 2024
-
migrate dependency to Bitnami Redis helm chart (buildfarm#1637)
* rework for bitnami redis helm chart * still doesn't work tho less specified * disable redis pwd -- not for production use * chart/bitnami-redis:18.14.2 * and later * stage chart v0.3.0
Configuration menu - View commit details
-
Copy full SHA for 14810a4 - Browse repository at this point
Copy the full SHA 14810a4View commit details
Commits on Aug 14, 2024
-
Merge commit '14810a42ec8ea1fd65009d1183dd37a8ace0a0e3' into jackies/…
…upgrade-bazel-buildfarm-to-v2.9.0
Configuration menu - View commit details
-
Copy full SHA for d6c1859 - Browse repository at this point
Copy the full SHA d6c1859View commit details
Commits on Aug 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 9938118 - Browse repository at this point
Copy the full SHA 9938118View commit details