Mass 301 redirect in htaccess

[moon-boots]

I use ScreamingFrog to generate sitemaps for my Magento 2 multistore, but I recently noticed two issues.

1. Each category/page has two URLs. One with / and the end and one without.
2. Every product has two URLs. One with /product-name and the other /shop/product-name.

The URLs are canonicalised, but this is still a problem and I'm not sure exactly how to execute this in the htaccess file.

So I need to:

1. Remove all URLs without the / at the end and redirect them all to the URL with / at the end. Or vice versa.
2. 301 redirect every single product (there are over 400) from shop/product-name to /product-name.

How do I do this en mass in the htaccess file?

[Martijn_Scheijbeler]

1. So for the first one what you want to do is a redirect and add the trailing slash. The .htaccess lines that you want to put in for that are:

RewriteCond %{REQUEST_URI} !(/$|.)
RewriteRule (.*) %{REQUEST_URI}/ [R=301,L]

[effectdigital]

This is solid advice

If OP has access to NginX redirects (usually requires shell access, and obviously NginX) which are generally deemed to be faster and more efficient than .htaccess rewrite rules, they could do something like

rewrite ^([^.]*[^/])$ $1/ permanent;

I got it from here: https://stackoverflow.com/questions/645853/add-slash-to-the-end-of-every-url-need-rewrite-rule-for-nginx

"The Regular Expression translates to: rewrite all URIs without any '.' in them that don't end with a '/' to the URI + '/'"

Not all sites run NginX, but many do

[moon-boots]

Hi Martijn,

The solution didn't work, I'm not sure if there is a conflict here but this is what my htaccess currently looks like:

RewriteEngine On
RewriteCond %{HTTPS} off
RewriteRule ^(.*)$ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301]

#RewriteCond %{HTTPS} !=on
#RewriteRule ^(.)$ https://thespacecollective.com/$1 [L,R=301]
#RewriteRule ^(.)$ https://www.thespacecollective.com/$1 [L,R=301]

<ifmodule pagespeed_module="">ModPagespeed off</ifmodule>

RewriteRule .* - [E=noabort:1]

RewriteRule .* - [E=noconntimeout:1]

<ifmodule mod_rewrite.c="">RewriteEngine On
RewriteCond %{HTTP_HOST} ^interstellarstore.com$ [OR]
RewriteCond %{HTTP_HOST} ^www.interstellarstore.com$</ifmodule>

RewriteRule (.*)$ https://www.thespacecollective.com/$1 [R=301,L]