Skip to content

[clang][CodeGen] Generate follow-up metadata for loops in correct format #131985

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 27, 2025
Merged

[clang][CodeGen] Generate follow-up metadata for loops in correct format #131985

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
133 changes: 58 additions & 75 deletions clang/lib/CodeGen/CGLoopInfo.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,20 +22,20 @@ using namespace clang::CodeGen;
using namespace llvm;

MDNode *
LoopInfo::createLoopPropertiesMetadata(ArrayRef<Metadata *> LoopProperties) {
LoopInfo::createFollowupMetadata(const char *FollowupName,
ArrayRef<llvm::Metadata *> LoopProperties) {
LLVMContext &Ctx = Header->getContext();
SmallVector<Metadata *, 4> NewLoopProperties;
NewLoopProperties.push_back(nullptr);
NewLoopProperties.append(LoopProperties.begin(), LoopProperties.end());

MDNode *LoopID = MDNode::getDistinct(Ctx, NewLoopProperties);
LoopID->replaceOperandWith(0, LoopID);
return LoopID;
SmallVector<Metadata *, 4> Args;
Args.push_back(MDString::get(Ctx, FollowupName));
Args.append(LoopProperties.begin(), LoopProperties.end());
return MDNode::get(Ctx, Args);
}

MDNode *LoopInfo::createPipeliningMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
SmallVector<Metadata *, 4>
LoopInfo::createPipeliningMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
LLVMContext &Ctx = Header->getContext();

std::optional<bool> Enabled;
Expand All @@ -44,23 +44,19 @@ MDNode *LoopInfo::createPipeliningMetadata(const LoopAttributes &Attrs,
else if (Attrs.PipelineInitiationInterval != 0)
Enabled = true;

SmallVector<Metadata *, 4> Args;
Args.append(LoopProperties.begin(), LoopProperties.end());

if (Enabled != true) {
SmallVector<Metadata *, 4> NewLoopProperties;
if (Enabled == false) {
NewLoopProperties.append(LoopProperties.begin(), LoopProperties.end());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line was not executed when Enabled == std::nullop, so llvm.mustprogress ([[MP]]) from LoopProperties is never added. Should have been added unconditionally.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When Enabled == std::nullopt, LoopProperties was used as is, not NewProperties. So I think the cause is elsewhere. Anyway, it's enough to know that llvm.mustprogress should be appended unconditionally, thanks.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In principle, LoopVectorize should know that if the original loop had a progress guarantee, then the vectorized loop will as well, so it should add llvm.loop.must_progress no matter what. I don't think it currently does.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In principle, LoopVectorize should know that if the original loop had a progress guarantee, then the vectorized loop will as well, so it should add llvm.loop.must_progress no matter what.

I think this is completely correct. What I didn't understand is, why the followup metadata of LOOP_6 (FOLLOW_VECTOR_6) didn't have llvm.mustprogress before this patch, but now it (FOLLOWUP_VECTOR_3) does. I investigated a little deeper and found the cause; FOLLOWUP_VECTOR_6 actually had mustprogress (?!). That is, the test passed for both of the following directives.

// Original.
// CHECK: ![[AFTER_VECTOR_6]] = distinct !{![[AFTER_VECTOR_6]], ![[ISVECTORIZED:.*]], ![[UNROLL_8:.*]]}

// This was also fine.
// CHECK: ![[AFTER_VECTOR_6]] = distinct !{![[AFTER_VECTOR_6]], [[MP]], ![[ISVECTORIZED:.*]], ![[UNROLL_8:.*]]}

Maybe FileCheck has a problem?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The same thing seems to happen elsewhere, e.g. LOOP_6 actually has vectorize.enable but is not included in the CHECK directive.

Copy link
Member

@Meinersbur Meinersbur Mar 28, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is due to the regex .* being too greedy, so e.g. ![[ISVECTORIZED:.*]] consumes multiple metadata nodes. A better one would be [_a-zA-Z0-9.]+. In principle ![[ISVECTORIZED]] = {!"llvm.loop.isvectorized"} (or UNROLL_8) should be verified somewhere, which would then fail if it matched more than one node.

IMHO there are lots of problems with FileCheck on LLVM-IR, and this is just one of them. Another one is that by default CHECK: pet store will match carpet store.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is due to the regex .* being too greedy, so e.g. ![[ISVECTORIZED:.*]] consumes multiple metadata nodes.

That makes sense! I got it, thank you!

Another one is that by default CHECK: pet store will match carpet store.

Ugh, that's a tricky problem.

NewLoopProperties.push_back(
Args.push_back(
MDNode::get(Ctx, {MDString::get(Ctx, "llvm.loop.pipeline.disable"),
ConstantAsMetadata::get(ConstantInt::get(
llvm::Type::getInt1Ty(Ctx), 1))}));
LoopProperties = NewLoopProperties;
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Different from this PR, but I think we should set HasUserTransforms to true here (same for other create*Metadata). If not, the user-specified `disable' attributes would not be generated properly.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is because by design pipeline is always the last transformation (it is implemented in the back-end, after all the IR optimization passes, there can be no transformation after this).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about other transformations, e.g., vectorization?

llvm-project/clang/lib/CodeGen/CGLoopInfo.cpp

Lines 213 to 220 in ce8febb

if (Enabled == false) {
NewLoopProperties.append(LoopProperties.begin(), LoopProperties.end());
NewLoopProperties.push_back(
MDNode::get(Ctx, {MDString::get(Ctx, "llvm.loop.vectorize.enable"),
ConstantAsMetadata::get(ConstantInt::get(
llvm::Type::getInt1Ty(Ctx), 0))}));
LoopProperties = NewLoopProperties;
}

I just looked for it and found an issue that might be caused by this.
#75839

}
return createLoopPropertiesMetadata(LoopProperties);
return Args;
}

SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(LoopProperties.begin(), LoopProperties.end());

if (Attrs.PipelineInitiationInterval > 0) {
Metadata *Vals[] = {
MDString::get(Ctx, "llvm.loop.pipeline.initiationinterval"),
Expand All @@ -71,13 +67,11 @@ MDNode *LoopInfo::createPipeliningMetadata(const LoopAttributes &Attrs,

// No follow-up: This is the last transformation.

MDNode *LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);
HasUserTransforms = true;
return LoopID;
return Args;
}

MDNode *
SmallVector<Metadata *, 4>
LoopInfo::createPartialUnrollMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
Expand Down Expand Up @@ -108,11 +102,10 @@ LoopInfo::createPartialUnrollMetadata(const LoopAttributes &Attrs,
MDNode::get(Ctx, MDString::get(Ctx, "llvm.loop.unroll.disable")));

bool FollowupHasTransforms = false;
MDNode *Followup = createPipeliningMetadata(Attrs, FollowupLoopProperties,
FollowupHasTransforms);
SmallVector<Metadata *, 4> Followup = createPipeliningMetadata(
Attrs, FollowupLoopProperties, FollowupHasTransforms);

SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(LoopProperties.begin(), LoopProperties.end());

// Setting unroll.count
Expand All @@ -130,16 +123,14 @@ LoopInfo::createPartialUnrollMetadata(const LoopAttributes &Attrs,
}

if (FollowupHasTransforms)
Args.push_back(MDNode::get(
Ctx, {MDString::get(Ctx, "llvm.loop.unroll.followup_all"), Followup}));
Args.push_back(
createFollowupMetadata("llvm.loop.unroll.followup_all", Followup));

MDNode *LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);
HasUserTransforms = true;
return LoopID;
return Args;
}

MDNode *
SmallVector<Metadata *, 4>
LoopInfo::createUnrollAndJamMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
Expand Down Expand Up @@ -170,11 +161,10 @@ LoopInfo::createUnrollAndJamMetadata(const LoopAttributes &Attrs,
MDNode::get(Ctx, MDString::get(Ctx, "llvm.loop.unroll_and_jam.disable")));

bool FollowupHasTransforms = false;
MDNode *Followup = createPartialUnrollMetadata(Attrs, FollowupLoopProperties,
FollowupHasTransforms);
SmallVector<Metadata *, 4> Followup = createPartialUnrollMetadata(
Attrs, FollowupLoopProperties, FollowupHasTransforms);

SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(LoopProperties.begin(), LoopProperties.end());

// Setting unroll_and_jam.count
Expand All @@ -192,22 +182,18 @@ LoopInfo::createUnrollAndJamMetadata(const LoopAttributes &Attrs,
}

if (FollowupHasTransforms)
Args.push_back(MDNode::get(
Ctx, {MDString::get(Ctx, "llvm.loop.unroll_and_jam.followup_outer"),
Followup}));
Args.push_back(createFollowupMetadata(
"llvm.loop.unroll_and_jam.followup_outer", Followup));

if (UnrollAndJamInnerFollowup)
Args.push_back(MDNode::get(
Ctx, {MDString::get(Ctx, "llvm.loop.unroll_and_jam.followup_inner"),
UnrollAndJamInnerFollowup}));
if (UnrollAndJamInnerFollowup.has_value())
Args.push_back(createFollowupMetadata(
"llvm.loop.unroll_and_jam.followup_inner", *UnrollAndJamInnerFollowup));

MDNode *LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);
HasUserTransforms = true;
return LoopID;
return Args;
}

MDNode *
SmallVector<Metadata *, 4>
LoopInfo::createLoopVectorizeMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
Expand Down Expand Up @@ -244,11 +230,10 @@ LoopInfo::createLoopVectorizeMetadata(const LoopAttributes &Attrs,
MDNode::get(Ctx, MDString::get(Ctx, "llvm.loop.isvectorized")));

bool FollowupHasTransforms = false;
MDNode *Followup = createUnrollAndJamMetadata(Attrs, FollowupLoopProperties,
FollowupHasTransforms);
SmallVector<Metadata *, 4> Followup = createUnrollAndJamMetadata(
Attrs, FollowupLoopProperties, FollowupHasTransforms);

SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(LoopProperties.begin(), LoopProperties.end());

// Setting vectorize.predicate when it has been specified and vectorization
Expand Down Expand Up @@ -315,17 +300,14 @@ LoopInfo::createLoopVectorizeMetadata(const LoopAttributes &Attrs,
}

if (FollowupHasTransforms)
Args.push_back(MDNode::get(
Ctx,
{MDString::get(Ctx, "llvm.loop.vectorize.followup_all"), Followup}));
Args.push_back(
createFollowupMetadata("llvm.loop.vectorize.followup_all", Followup));

MDNode *LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);
HasUserTransforms = true;
return LoopID;
return Args;
}

MDNode *
SmallVector<Metadata *, 4>
LoopInfo::createLoopDistributeMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
Expand All @@ -352,11 +334,10 @@ LoopInfo::createLoopDistributeMetadata(const LoopAttributes &Attrs,
}

bool FollowupHasTransforms = false;
MDNode *Followup =
SmallVector<Metadata *, 4> Followup =
createLoopVectorizeMetadata(Attrs, LoopProperties, FollowupHasTransforms);

SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(LoopProperties.begin(), LoopProperties.end());

Metadata *Vals[] = {MDString::get(Ctx, "llvm.loop.distribute.enable"),
Expand All @@ -366,19 +347,17 @@ LoopInfo::createLoopDistributeMetadata(const LoopAttributes &Attrs,
Args.push_back(MDNode::get(Ctx, Vals));

if (FollowupHasTransforms)
Args.push_back(MDNode::get(
Ctx,
{MDString::get(Ctx, "llvm.loop.distribute.followup_all"), Followup}));
Args.push_back(
createFollowupMetadata("llvm.loop.distribute.followup_all", Followup));

MDNode *LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);
HasUserTransforms = true;
return LoopID;
return Args;
}

MDNode *LoopInfo::createFullUnrollMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
SmallVector<Metadata *, 4>
LoopInfo::createFullUnrollMetadata(const LoopAttributes &Attrs,
ArrayRef<Metadata *> LoopProperties,
bool &HasUserTransforms) {
LLVMContext &Ctx = Header->getContext();

std::optional<bool> Enabled;
Expand All @@ -400,20 +379,17 @@ MDNode *LoopInfo::createFullUnrollMetadata(const LoopAttributes &Attrs,
}

SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(LoopProperties.begin(), LoopProperties.end());
Args.push_back(MDNode::get(Ctx, MDString::get(Ctx, "llvm.loop.unroll.full")));

// No follow-up: there is no loop after full unrolling.
// TODO: Warn if there are transformations after full unrolling.

MDNode *LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);
HasUserTransforms = true;
return LoopID;
return Args;
}

MDNode *LoopInfo::createMetadata(
SmallVector<Metadata *, 4> LoopInfo::createMetadata(
const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> AdditionalLoopProperties,
bool &HasUserTransforms) {
Expand Down Expand Up @@ -579,8 +555,8 @@ void LoopInfo::finish() {
MDNode::get(Ctx, MDString::get(Ctx, "llvm.loop.isvectorized")));

bool InnerFollowupHasTransform = false;
MDNode *InnerFollowup = createMetadata(AfterJam, BeforeLoopProperties,
InnerFollowupHasTransform);
SmallVector<Metadata *, 4> InnerFollowup = createMetadata(
AfterJam, BeforeLoopProperties, InnerFollowupHasTransform);
if (InnerFollowupHasTransform)
Parent->UnrollAndJamInnerFollowup = InnerFollowup;
}
Expand All @@ -589,7 +565,14 @@ void LoopInfo::finish() {
}

bool HasUserTransforms = false;
LoopID = createMetadata(CurLoopAttr, {}, HasUserTransforms);
SmallVector<Metadata *, 4> Properties =
createMetadata(CurLoopAttr, {}, HasUserTransforms);
SmallVector<Metadata *, 4> Args;
Args.push_back(nullptr);
Args.append(Properties.begin(), Properties.end());
LoopID = MDNode::getDistinct(Ctx, Args);
LoopID->replaceOperandWith(0, LoopID);

TempLoopID->replaceAllUsesWith(LoopID);
}

Expand Down
43 changes: 23 additions & 20 deletions clang/lib/CodeGen/CGLoopInfo.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -132,17 +132,19 @@ class LoopInfo {
/// If this loop has unroll-and-jam metadata, this can be set by the inner
/// loop's LoopInfo to set the llvm.loop.unroll_and_jam.followup_inner
/// metadata.
llvm::MDNode *UnrollAndJamInnerFollowup = nullptr;
std::optional<llvm::SmallVector<llvm::Metadata *, 4>>
UnrollAndJamInnerFollowup;

/// Create a LoopID without any transformations.
/// Create a followup MDNode that has @p LoopProperties as its attributes.
llvm::MDNode *
createLoopPropertiesMetadata(llvm::ArrayRef<llvm::Metadata *> LoopProperties);
createFollowupMetadata(const char *FollowupName,
llvm::ArrayRef<llvm::Metadata *> LoopProperties);

/// Create a LoopID for transformations.
/// Create a metadata list for transformations.
///
/// The methods call each other in case multiple transformations are applied
/// to a loop. The transformation first to be applied will use LoopID of the
/// next transformation in its followup attribute.
/// to a loop. The transformation first to be applied will use metadata list
/// of the next transformation in its followup attribute.
///
/// @param Attrs The loop's transformations.
/// @param LoopProperties Non-transformation properties such as debug
Expand All @@ -152,36 +154,37 @@ class LoopInfo {
/// @param HasUserTransforms [out] Set to true if the returned MDNode encodes
/// at least one transformation.
///
/// @return A LoopID (metadata node) that can be used for the llvm.loop
/// annotation or followup-attribute.
/// @return A metadata list that can be used for the llvm.loop annotation or
/// followup-attribute.
/// @{
llvm::MDNode *
llvm::SmallVector<llvm::Metadata *, 4>
createPipeliningMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
llvm::MDNode *
llvm::SmallVector<llvm::Metadata *, 4>
createPartialUnrollMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
llvm::MDNode *
llvm::SmallVector<llvm::Metadata *, 4>
createUnrollAndJamMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
llvm::MDNode *
llvm::SmallVector<llvm::Metadata *, 4>
createLoopVectorizeMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
llvm::MDNode *
llvm::SmallVector<llvm::Metadata *, 4>
createLoopDistributeMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
llvm::MDNode *
llvm::SmallVector<llvm::Metadata *, 4>
createFullUnrollMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);

/// @}

/// Create a LoopID for this loop, including transformation-unspecific
/// Create a metadata list for this loop, including transformation-unspecific
/// metadata such as debug location.
///
/// @param Attrs This loop's attributes and transformations.
Expand All @@ -191,11 +194,11 @@ class LoopInfo {
/// @param HasUserTransforms [out] Set to true if the returned MDNode encodes
/// at least one transformation.
///
/// @return A LoopID (metadata node) that can be used for the llvm.loop
/// annotation.
llvm::MDNode *createMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
/// @return A metadata list that can be used for the llvm.loop annotation.
llvm::SmallVector<llvm::Metadata *, 4>
createMetadata(const LoopAttributes &Attrs,
llvm::ArrayRef<llvm::Metadata *> LoopProperties,
bool &HasUserTransforms);
};

/// A stack of loop information corresponding to loop nesting levels.
Expand Down
9 changes: 3 additions & 6 deletions clang/test/CodeGenCXX/pragma-followup_inner.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,20 +23,17 @@ extern "C" void followup_inner(int n, int *x) {
// CHECK-DAG: ![[INNERLOOP_3]] = distinct !{![[INNERLOOP_3]], ![[PARALLEL_ACCESSES_4:[0-9]+]], ![[DISTRIBUTE_5:[0-9]+]], ![[DISTRIBUTE_FOLLOWUP_6:[0-9]+]]}
// CHECK-DAG: ![[PARALLEL_ACCESSES_4]] = !{!"llvm.loop.parallel_accesses", ![[ACCESSGROUP_2]]}
// CHECK-DAG: ![[DISTRIBUTE_5]] = !{!"llvm.loop.distribute.enable", i1 true}
// CHECK-DAG: ![[DISTRIBUTE_FOLLOWUP_6]] = !{!"llvm.loop.distribute.followup_all", ![[LOOP_7:[0-9]+]]}

// CHECK-DAG: ![[LOOP_7]] = distinct !{![[LOOP_7]], ![[PARALLEL_ACCESSES_4]], ![[VECTORIZE_8:[0-9]+]]}
// CHECK-DAG: ![[DISTRIBUTE_FOLLOWUP_6]] = !{!"llvm.loop.distribute.followup_all", ![[PARALLEL_ACCESSES_4]], ![[VECTORIZE_8:[0-9]+]]}
// CHECK-DAG: ![[VECTORIZE_8]] = !{!"llvm.loop.vectorize.enable", i1 true}

// CHECK-DAG: ![[OUTERLOOP_9]] = distinct !{![[OUTERLOOP_9]], [[MP:![0-9]+]], ![[UNROLLANDJAM_COUNT_10:[0-9]+]], ![[UNROLLANDJAM_FOLLOWUPINNER_11:[0-9]+]]}
// CHECK-DAG: ![[UNROLLANDJAM_COUNT_10]] = !{!"llvm.loop.unroll_and_jam.count", i32 4}
// CHECK-DAG: ![[UNROLLANDJAM_FOLLOWUPINNER_11]] = !{!"llvm.loop.unroll_and_jam.followup_inner", ![[LOOP_12:[0-9]+]]}

// CHECK-DAG: ![[LOOP_12]] = distinct !{![[LOOP_12:[0-9]+]], ![[PARALLEL_ACCESSES_4]], ![[ISVECTORIZED_13:[0-9]+]], ![[UNROLL_COUNT_13:[0-9]+]], ![[UNROLL_FOLLOWUP_14:[0-9]+]]}
// CHECK-DAG: ![[UNROLLANDJAM_FOLLOWUPINNER_11]] = !{!"llvm.loop.unroll_and_jam.followup_inner", ![[PARALLEL_ACCESSES_4]], ![[ISVECTORIZED_13:[0-9]+]], ![[UNROLL_COUNT_13:[0-9]+]], ![[UNROLL_FOLLOWUP_14:[0-9]+]]}
// CHECK-DAG: ![[ISVECTORIZED_13]] = !{!"llvm.loop.isvectorized"}
// CHECK-DAG: ![[UNROLL_COUNT_13]] = !{!"llvm.loop.unroll.count", i32 4}
// CHECK-DAG: ![[UNROLL_FOLLOWUP_14]] = !{!"llvm.loop.unroll.followup_all", ![[LOOP_15:[0-9]+]]}

// CHECK-DAG: ![[LOOP_15]] = distinct !{![[LOOP_15]], ![[PARALLEL_ACCESSES_4]], ![[ISVECTORIZED_13]], ![[UNROLL_DISABLE_16:[0-9]+]], ![[PIPELINE_17:[0-9]+]]}
// CHECK-DAG: ![[UNROLL_FOLLOWUP_14]] = !{!"llvm.loop.unroll.followup_all", ![[PARALLEL_ACCESSES_4]], ![[ISVECTORIZED_13]], ![[UNROLL_DISABLE_16:[0-9]+]], ![[PIPELINE_17:[0-9]+]]}
// CHECK-DAG: ![[UNROLL_DISABLE_16]] = !{!"llvm.loop.unroll.disable"}
// CHECK-DAG: ![[PIPELINE_17]] = !{!"llvm.loop.pipeline.initiationinterval", i32 10}
Loading