chore(releasing): prepare v0.51.1 release (#24214)

* chore(ci): reorganize integration test files (#24108)

* chore(ci): reorganize integration test files

* revert nats data move

* fix paths to data

* fix more paths

* amqp fix

* Fix logstash int tests shared files paths

* Rename scripts/integration -> tests/integration

* scripts/integration -> tests/integration in source files

* Fix scripts->tests

* Fix gcp paths

* Fix http-client pem path

* move nats data

---------

Co-authored-by: Thomas <[email protected]>

* chore(vdev): move all utils in a new utils folder (#24143)

* chore(vdev): move all utils in a new utils folder

* move remaining files to utils dir

* move remaining files to utils dir

* fmt

* chore(vdev): make modules visible to rustfmt (#24162)

* Remove mod inside cli_subcommands macro

* cargo fmt

* chore(vdev): apply vdev rust check fixes

* Link to rustfmt issue

* fix(vdev): release prepare vrl version pinning (#24158)

* Add --dry-run to release prepare

* Add error handling and checks to pin_vrl_version

* Add wrapper to toml

* Remove wrapper, parse as Table instead

* Fix vrl pinning logic

* Enable preserve_order feature in toml crate

* Use dependency instead of whole toml

* Fix dry run docs

* Fix dry run wording

* refactor to use toml_edit

* Add update_vrl_to_version to add unit test

* Use indoc in prepare.rs

* Remove preserve_order feature

* chore(deps): update VRL to add missing stdlib fns from 0.28 (#24178)

* chore(ci): temporarily remove homebrew publish step from publish workflow (#24185)

This temporarily removes the publish-homebrew job from the publish
workflow to address issue #24139. This is step 1 of the plan to fix
the homebrew publishing process.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude <[email protected]>

* fix(blackhole sink): disable rate limiting for periodic stats messages (#24190)

* fix(blackhole sink): disable rate limiting for periodic stats messages

The blackhole sink's informational "Collected events" messages were being
rate-limited since rate limiting was enabled by default in #24024. This is
undesirable because:

1. These are deliberately scheduled periodic messages (controlled by the
   `print_interval_secs` config option), not error conditions that could
   flood the logs
2. Users explicitly configure the frequency - rate limiting defeats that
   explicit configuration and breaks user expectations
3. The interval timer already prevents log flooding, making additional
   rate limiting redundant
4. The blackhole sink is used for debugging/testing, where predictable
   output is essential

This fix adds `internal_log_rate_limit = false` to both info! calls,
similar to how the console sink disables rate limiting for its critical
operational messages.

Fixes #24188

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>

* chore: add changelog fragment for blackhole sink rate limiting fix

---------

Co-authored-by: Claude <[email protected]>

* chore(internal logs): Disable rate limiting for critical internal error logs (#24192)

* Improve debug log in aws_ecs_metrics

* Add internal_log_rate_limit = false to config reload errors

* Disable rate limiting for lua build failure

* Disable rate limiting for amqp build failure

* Add internal_log_rate_limit = false to important failures during reload

* Disable log rate limit for repeated events in process.rs

* Update src/config/watcher.rs

* Fix message format

* fix(tracing): prevent panic for traces without standard fields (#24191)

* fix(tracing): prevent panic for traces without std fields

* forbid unwrap in this lib

* clippy fix

* improve events_with_custom_fields_no_message_dont_panic, advance to next window

* chore(tracing): do not rate limit utlization report (#24202)

* chore(internal metrics): move config_reload_* metrics to VectorReload* (#24203)

* chore(internal metrics): move config_reload_* metrics to VectorReloaded and VectorReloadedError

* update topology_doesnt_reload_new_data_dir test

* chore(dev): cargo fmt

* strengthen tests, since now we have a better interface

* chore(releasing): Add 0.51.0 known issues (#24211)

* Format fixes

* Add 0.51.0 known issues

* Add dots

* Reword log panic known issue

* Reword VRL missing fns

* Backtick versions

* Update website/cue/reference/releases/0.51.0.cue

Co-authored-by: Pavlos Rontidis <[email protected]>

* Fix cue docs fmt

---------

Co-authored-by: Pavlos Rontidis <[email protected]>

* Bump vector version to 0.51.1

* Bump VRL to 0.28.1

* Generate 0.51.1 cue

* Add vrl_changelog

* Remove whitespace

* chore(releasing): Updated distribution/install.sh vector version to 0.51.1

* chore(releasing): Add 0.51.1 to versions.cue

* chore(releasing): Created release md file

* Add description

* Reorder items and fix format

* Finally fix styling

* Bump date

---------

Co-authored-by: Pavlos Rontidis <[email protected]>
Co-authored-by: Claude <[email protected]>

chore(releasing): pull in `internal_logs` fix into 0.51.1 (#24225)

* fix(internal_logs source): remove rate limit (#24218)

* fix(internal_logs source): remove rate limit

* add changelog

* Debug commit

* Fix validated - Revert "Debug commit"

This reverts commit c7b9ec9.

* add unit test

* fix check-events

* Pull in internal_logs source fix

* Add internal_logs known issue

* Bump date

* Update website/cue/reference/releases/0.51.0.cue

Co-authored-by: Pavlos Rontidis <[email protected]>

---------

Co-authored-by: Pavlos Rontidis <[email protected]>

Author: thomasqueirozb

.github/workflows/changes.yml

@@ -324,7 +324,7 @@ jobs:
 
       # creates a yaml file that contains the filters for each integration,
       # extracted from the output of the `vdev int ci-paths` command, which
-      # sources the paths from the scripts/integration/.../test.yaml files
+      # sources the paths from the tests/integration/.../config/test.yaml files
       - name: Create filter rules for integrations
         run: vdev int ci-paths > int_test_filters.yaml
 

.github/workflows/publish.yml

@@ -835,15 +835,3 @@ jobs:
         with:
           name: vector-${{ env.VECTOR_VERSION }}-SHA256SUMS
           path: target/artifacts/vector-${{ env.VECTOR_VERSION }}-SHA256SUMS
-
-  publish-homebrew:
-    name: Publish to Homebrew
-    # We only publish versioned releases to Homebrew.
-    if: ${{ inputs.channel == 'release' }}
-    uses: ./.github/workflows/publish-homebrew.yml
-    needs:
-      - generate-publish-metadata
-      - publish-s3
-    with:
-      git_ref: ${{ inputs.git_ref }}
-      vector_version: ${{ needs.generate-publish-metadata.outputs.vector_version }}

Cargo.lock

@@ -1,6 +1,6 @@
 [package]
 name = "vector"
-version = "0.51.0"
+version = "0.51.1"
 authors = ["Vector Contributors <[email protected]>"]
 edition = "2024"
 description = "A lightweight and ultra-fast tool for building observability pipelines"
@@ -198,7 +198,7 @@ vector-config = { path = "lib/vector-config" }
 vector-config-common = { path = "lib/vector-config-common" }
 vector-config-macros = { path = "lib/vector-config-macros" }
 vector-lib = { path = "lib/vector-lib", default-features = false, features = ["vrl"] }
-vrl = { git = "https://github.com/vectordotdev/vrl.git", branch = "main", features = ["arbitrary", "cli", "test", "test_framework"] }
+vrl = { version = "0.28.1", features = ["arbitrary", "cli", "test", "test_framework"] }
 mock_instant = { version = "0.6" }
 serial_test = { version = "3.2" }
 

Cargo.toml

@@ -1,4 +1,5 @@
 large-error-threshold = 256  # in bytes
+allow-unwrap-in-tests = true
 
 # for `disallowed_method`:
 # https://rust-lang.github.io/rust-clippy/master/index.html#disallowed_method

clippy.toml

@@ -13,7 +13,7 @@ set -u
 # If PACKAGE_ROOT is unset or empty, default it.
 PACKAGE_ROOT="${PACKAGE_ROOT:-"https://packages.timber.io/vector"}"
 # If VECTOR_VERSION is unset or empty, default it.
-VECTOR_VERSION="${VECTOR_VERSION:-"0.51.0"}"
+VECTOR_VERSION="${VECTOR_VERSION:-"0.51.1"}"
 _divider="--------------------------------------------------------------------------------"
 _prompt=">>>"
 _indent="   "

distribution/install.sh

@@ -6,6 +6,9 @@ edition = "2024"
 publish = false
 license = "MPL-2.0"
 
+[lints.clippy]
+unwrap-used = "forbid"
+
 [dependencies]
 tracing-core = { version = "0.1", default-features = false }
 tracing-subscriber = { workspace = true, features = ["registry", "std"] }

lib/tracing-limit/Cargo.toml

@@ -114,17 +114,17 @@ where
     }
 
     fn on_new_span(&self, span: &span::Attributes<'_>, _id: &span::Id, _ctx: Context<'_, S>) {
-        let mut visitor = Visitor(self.mutex.lock().unwrap());
+        let mut visitor = Visitor(self.mutex.lock().expect("mutex should not be poisoned"));
         span.record(&mut visitor);
     }
 
     fn on_record(&self, _id: &span::Id, values: &span::Record<'_>, _ctx: Context<'_, S>) {
-        let mut visitor = Visitor(self.mutex.lock().unwrap());
+        let mut visitor = Visitor(self.mutex.lock().expect("mutex should not be poisoned"));
         values.record(&mut visitor);
     }
 
     fn on_event(&self, event: &Event<'_>, _ctx: Context<'_, S>) {
-        let mut visitor = Visitor(self.mutex.lock().unwrap());
+        let mut visitor = Visitor(self.mutex.lock().expect("mutex should not be poisoned"));
         event.record(&mut visitor);
     }
 

lib/tracing-limit/benches/limit.rs

@@ -377,15 +377,17 @@ where
             let valueset = fields.value_set(&values);
             let event = Event::new(metadata, &valueset);
             self.inner.on_event(&event, ctx.clone());
-        } else {
-            let values = [(
-                &fields.field(RATE_LIMIT_FIELD).unwrap(),
-                Some(&rate_limit as &dyn Value),
-            )];
+        } else if let Some(rate_limit_field) = fields.field(RATE_LIMIT_FIELD) {
+            let values = [(&rate_limit_field, Some(&rate_limit as &dyn Value))];
 
             let valueset = fields.value_set(&values);
             let event = Event::new(metadata, &valueset);
             self.inner.on_event(&event, ctx.clone());
+        } else {
+            // If the event metadata has neither a "message" nor "internal_log_rate_limit" field,
+            // we cannot create a proper synthetic event. This can happen with custom debug events
+            // that have their own field structure. In this case, we simply skip emitting the
+            // rate limit notification rather than panicking.
         }
     }
 }
@@ -1012,4 +1014,42 @@ mod test {
             ]
         );
     }
+
+    #[test]
+    #[serial]
+    fn events_with_custom_fields_no_message_dont_panic() {
+        // Verify events without "message" or "internal_log_rate_limit" fields don't panic
+        // when rate limiting skips suppression notifications.
+        let (events, sub) = setup_test(1);
+        tracing::subscriber::with_default(sub, || {
+            // Use closure to ensure all events share the same callsite
+            let emit_event = || {
+                debug!(component_id = "test_component", utilization = 0.85);
+            };
+
+            // First window: emit 5 events, only the first one should be logged
+            for _ in 0..5 {
+                emit_event();
+                MockClock::advance(Duration::from_millis(100));
+            }
+
+            // Advance to the next window
+            MockClock::advance(Duration::from_millis(1000));
+
+            // Second window: this event should be logged
+            emit_event();
+        });
+
+        let events = events.lock().unwrap();
+
+        // First event from window 1, first event from window 2
+        // Suppression notifications are skipped (no message field)
+        assert_eq!(
+            *events,
+            vec![
+                event!("", component_id: "test_component", utilization: "0.85"),
+                event!("", component_id: "test_component", utilization: "0.85"),
+            ]
+        );
+    }
 }

lib/tracing-limit/src/lib.rs

@@ -147,19 +147,38 @@ pub fn spawn_thread<'a>(
                                 .all(|(_, t)| *t == ComponentType::EnrichmentTable)
                             {
                                 info!("Only enrichment tables have changed.");
-                                _ = signal_tx.send(crate::signal::SignalTo::ReloadEnrichmentTables).map_err(|error| {
-                                error!(message = "Unable to reload enrichment tables.", cause = %error)
-                            });
+                                _ = signal_tx
+                                    .send(crate::signal::SignalTo::ReloadEnrichmentTables)
+                                    .map_err(|error| {
+                                        error!(
+                                            message = "Unable to reload enrichment tables.",
+                                            cause = %error,
+                                            internal_log_rate_limit = false,
+                                        )
+                                    });
                             } else {
-                                _ = signal_tx.send(crate::signal::SignalTo::ReloadComponents(changed_components.into_keys().collect())).map_err(|error| {
-                                error!(message = "Unable to reload component configuration. Restart Vector to reload it.", cause = %error)
-                            });
+                                _ = signal_tx
+                                    .send(crate::signal::SignalTo::ReloadComponents(
+                                        changed_components.into_keys().collect(),
+                                    ))
+                                    .map_err(|error| {
+                                        error!(
+                                            message = "Unable to reload component configuration. Restart Vector to reload it.",
+                                            cause = %error,
+                                            internal_log_rate_limit = false,
+                                        )
+                                    });
                             }
                         } else {
-                            _ = signal_tx.send(crate::signal::SignalTo::ReloadFromDisk)
-                            .map_err(|error| {
-                                error!(message = "Unable to reload configuration file. Restart Vector to reload it.", cause = %error)
-                            });
+                            _ = signal_tx
+                                .send(crate::signal::SignalTo::ReloadFromDisk)
+                                .map_err(|error| {
+                                    error!(
+                                        message = "Unable to reload configuration file. Restart Vector to reload it.",
+                                        cause = %error,
+                                        internal_log_rate_limit = false,
+                                    )
+                                });
                         }
                     } else {
                         debug!(message = "Ignoring event.", event = ?event)