aboutsummaryrefslogtreecommitdiffstats
path: root/lib
diff options
context:
space:
mode:
authorMatthew Ahrens <[email protected]>2020-03-18 13:31:10 -0700
committerGitHub <[email protected]>2020-03-18 13:31:10 -0700
commit652bdc9b0ed73476c4120dc2db16bd2f16f63708 (patch)
tree1304a0cdf911876b9104c3b86c97df01d308ccb0 /lib
parent22df2457a7b8265d999a2fe48f3e8e941c8fdde5 (diff)
Deprecate deduplicated send streams
Dedup send can only deduplicate over the set of blocks in the send command being invoked, and it does not take advantage of the dedup table to do so. This is a very common misconception among not only users, but developers, and makes the feature seem more useful than it is. As a result, many users are using the feature but not getting any benefit from it. Dedup send requires a nontrivial expenditure of memory and CPU to operate, especially if the dataset(s) being sent is (are) not already using a dedup-strength checksum. Dedup send adds developer burden. It expands the test matrix when developing new features, causing bugs in released code, and delaying development efforts by forcing more testing to be done. As a result, we are deprecating the use of `zfs send -D` and receiving of such streams. This change adds a warning to the man page, and also prints the warning whenever dedup send or receive are used. In a future release, we plan to: 1. remove the kernel code for generating deduplicated streams 2. make `zfs send -D` generate regular, non-deduplicated streams 3. remove the kernel code for receiving deduplicated streams 4. make `zfs receive` of deduplicated streams process them in userland to "re-duplicate" them, so that they can still be received. Reviewed-by: Paul Dagnelie <[email protected]> Reviewed-by: Brian Behlendorf <[email protected]> Reviewed-by: George Melikov <[email protected]> Signed-off-by: Matthew Ahrens <[email protected]> Closes #7887 Closes #10117
Diffstat (limited to 'lib')
-rw-r--r--lib/libzfs/libzfs_sendrecv.c20
1 files changed, 20 insertions, 0 deletions
diff --git a/lib/libzfs/libzfs_sendrecv.c b/lib/libzfs/libzfs_sendrecv.c
index ce6a2737b..138d1ba08 100644
--- a/lib/libzfs/libzfs_sendrecv.c
+++ b/lib/libzfs/libzfs_sendrecv.c
@@ -4740,6 +4740,26 @@ zfs_receive_one(libzfs_handle_t *hdl, int infd, const char *tosnap,
(void) printf("found clone origin %s\n", origin);
}
+ if (!hdl->libzfs_dedup_warning_printed &&
+ (DMU_GET_FEATUREFLAGS(drrb->drr_versioninfo) &
+ DMU_BACKUP_FEATURE_DEDUP)) {
+ (void) fprintf(stderr,
+ gettext("WARNING: This is a deduplicated send stream. "
+ "The ability to send and\n"
+ "receive deduplicated send streams is deprecated. "
+ "In the future, the\n"
+ "ability to receive a deduplicated send stream with "
+ "\"zfs receive\" will be\n"
+ "removed. However, in the future, a utility will be "
+ "provided to convert a\n"
+ "deduplicated send stream to a regular "
+ "(non-deduplicated) stream. This\n"
+ "future utility will require that the send stream be "
+ "located in a\n"
+ "seek-able file, rather than provided by a pipe.\n\n"));
+ hdl->libzfs_dedup_warning_printed = B_TRUE;
+ }
+
boolean_t resuming = DMU_GET_FEATUREFLAGS(drrb->drr_versioninfo) &
DMU_BACKUP_FEATURE_RESUMING;
boolean_t raw = DMU_GET_FEATUREFLAGS(drrb->drr_versioninfo) &