• Latency: You have to wait for all items to be produced before you can start processing any of them.
• Memory Consumption: All items must be held in memory simultaneously, which can be problematic for large datasets.

Introducing IAsyncEnumerable

IAsyncEnumerable allows you to asynchronously iterate over a sequence of data, yielding items one by one as they become available. This combines the benefits of asynchronous programming with the efficiency of streaming data.

Producing an Async Stream:

public static async IAsyncEnumerable GenerateNumbersAsync() { for (int i = 0; i < 10; i++) { await Task.Delay(100); // Simulate async work yield return i; } }

Consuming an Async Stream with await foreach:

public static async Task ConsumeNumbersAsync() { await foreach (var number in GenerateNumbersAsync()) { Console.WriteLine($"Received: {number}"); } } // To run this: // await ConsumeNumbersAsync();

Error Handling and Cancellation

Error handling works as expected with try-catch blocks. For cancellation, you can pass a CancellationToken to your IAsyncEnumerable producer and consumer methods.

public static async IAsyncEnumerable GenerateCancellableNumbersAsync([EnumeratorCancellation] CancellationToken cancellationToken = default) { for (int i = 0; i < 10; i++) { cancellationToken.ThrowIfCancellationRequested(); await Task.Delay(100, cancellationToken); yield return i; } } public static async Task ConsumeCancellableNumbersAsync() { using var cts = new CancellationTokenSource(500); // Cancel after 500ms try { await foreach (var number in GenerateCancellableNumbersAsync(cts.Token)) { Console.WriteLine($"Received: {number}"); } } catch (OperationCanceledException) { Console.WriteLine("Operation cancelled!"); } }

Conclusion

IAsyncEnumerable is a powerful addition to C# for handling asynchronous data streams, enabling more responsive and memory-efficient applications. It's particularly useful for scenarios like reading from databases, file streams, or network APIs where data arrives incrementally.