Class NoDuplicatesResourceRetriever

    • Field Detail

      • processedUrls

        private final java.util.Set<java.lang.String> processedUrls
    • Method Detail

      • getInputStreamByUrl

        public java.io.InputStream getInputStreamByUrl​(java.net.URL url)
                                                throws java.io.IOException
        Description copied from class: DefaultResourceRetriever
        Gets the input stream with current limit on the number of bytes read, that connect with source URL for retrieving data from that connection.
        Specified by:
        getInputStreamByUrl in interface IResourceRetriever
        Overrides:
        getInputStreamByUrl in class DefaultResourceRetriever
        Parameters:
        url - the source URL
        Returns:
        the limited input stream or null if the URL was filtered
        Throws:
        java.io.IOException - if any input/output issue occurs