- Account Basics
- Feeds and Search Options
- Report Management
- Basic Statistics
- Advanced Analytics
- Raw Data and Filtering
- 1. I created a new account but I still can’t log in, why?
After registering, you should have received an e-mail confirming your registration. Open that e-mail and click on the provided link to complete the registration process. If you have not received the e-mail, please check your spam folder or contact us to help resolve the issue.
- 2. Scraawl does not accept my password. What should I do?
Make sure your password is at least 8 characters long and contains at least one letter, one number, and one of the following special characters: ! @ * # $ _% ^
- 3. I forgot my password. What should I do?
Use the Forgot password? link on the Scraawl home page, and follow the instructions to reset your password.
- 4. How do I close or delete my Scraawl account?
Go to your My Profile page and click on the Delete Scraawl Account button at the bottom of the page.
- 1. What social media feeds can I search and analyze with Scraawl?
Scraawl currently supports search and analytics on posts from Twitter, Instagram, Tumblr, YouTube, and RSS news feeds. The feeds and analytics available depend on your account type (Personal, Professional, Premium, or Enterprise) and individual feed limits can be found on your My Profile page. New social media feeds are constantly being added to Scraawl. Be sure to check your account periodically.
- 2. Why does Scraawl ask me to link my social media accounts with Scraawl? How do you use my account data?
Linking your social media accounts authorizes Scraawl to perform search on your behalf, using your personal user token to collect data regarding your social network that could otherwise not be accessed. Linking your social media accounts will also provide you with access to a larger set of data for analytics such as the friendship graph and social engagement metrics (e.g., reach, impressions, followers, etc.). Scraawl does not store any personnel information from your account.
- 3. If I link my account with Scraawl is my personal user token shared with other Scraawl users?
No. Your user account and associated application token is only used when you create reports with your Scraawl login. Other Scraawl users either use Scraawl’s dedicated application tokens or their own personal tokens. You can always choose to unlink your personal social media accounts from the My Profile page.
- 4. What is the difference between Basic, Premium, and Premium Advanced Search?
Basic Search is available to all users and uses the feed’s public API to find posts that match the specified search criteria. A very limited number of posts are returned based on the selected feed, and are meant to serve as preview of the type of data that is available in Scraawl. Basic Search only supports streaming searches based on keywords. Premium and Premium Advanced Search are only available to Professional, Premium, and Enterprise account holders. Premium Search provides a much wider range of search options, such as streaming and historic search, and search by region, user, language, etc. Premium search also provides firehose or managed access to a feed. The number of posts returned can be specified up to the max report quota allowed by your account (see My Profile page). Premium Advanced Search allows users to use a search grammar with over 100 rules to construct an advanced search query.
- 5. What happens when I enter multiple search terms in the search keyword field? Are they AND’ed or OR’ed?
In Basic and Premium Search, multiple keywords separated with commas are OR’ed, i.e., posts that contain one or more of the keywords are returned. Multiple keywords separated by spaces are AND’ed, i.e., posts that contain all keywords are returned. Advanced Premium Search uses a separate search grammar and the details of the grammar can be found here (https://blog.scraawl.com/2015/02/gnip-search-powertrack-rules/).
- 6. What is brand monitoring?
Brand Monitoring is focused on collecting posts related to a brand’s social media account (posted by or mentioning) or a specific hashtag for purposes of brand reputation management. Up to 10 brands can be tracked in a single report. Brand reports appear in a designated area on the My Reports page. Brand reports include advanced analytics associated with social metrics such as reach, engagement, and impressions which are not available for regular search reports.
- 7. Can I search a social media feed in multiple languages?
Yes. With Scraawl you can search across 90+ languages. Use the Translate keywords function to enter keywords in other languages. Any foreign language posts returned from your search can also be translated into English using Scraawl’s Translate function.
- 8. Why does every feed have different search options?
The choice of search options is driven, in part, by the APIs (firehose or managed access) available from the data providers. Feeds with richer APIs provide a wider range of search options.
- 9. What is the difference between Streaming, Last 30 days, and Recent when conducting a search?
Streaming should be used if you are interested in collecting REAL-TIME data. That is, posts matching your search criteria will be captured as they are posted (until you reach your report quota). This is often referred to as “listening” in social media. Depending on the current social media activity matching your search criteria, your search may take time to return any posts. The Last 30 days and Recent search options go back into the specified time window to find posts matching your search criteria that have ALREADY been posted.
- 10. What is a rollover report?
Streaming searches in Scraawl stop collecting data when the report limit is reached or when the search times out. To continue the search, you must manually create a new report with the same search criteria. The rollover report feature automatically creates a new report when the report limit is reached (if your report quota allows), keeping data collection going.
- 11. What does Edit Report do?
Edit Report allows you to edit the search terms of a Basic Search report that is active and running. Edit Report cannot be used for Premium or Premium Advanced Search reports. When a Basic Search report is edited, the new search criteria are only applied from that point forward in time. Any data collected prior to the editing of the search terms will not be updated.
- 12. I started my search but don't see any results. Why?
Once you start Scraawling, it can take up to two minutes for the first batch of search results to be returned. New results are then returned in batches every 3 minutes.
- 13. My search is not returning any results even after 5 minutes. Why?
Make sure that your keywords are not too constraining. Try using broader search criteria.
- 1. How many reports can I set up and how many posts can I collect per report?
The number of reports allowed, and posts per report depends on your account privileges. Go to the My Profile page to see your account privileges. There are limits on the number of Search Reports, Streaming Reports, Brand Reports, Archived Reports, Shared Reports, and Case Reports.
- 2. Is there a limit to the number of reports I can share?
Yes, your account type determines the number of reports that you can share. Check the My Profile page to see your account privileges.
- 3. What is a Streaming Report?
A Streaming Report is one that has a search in progress. On the My Report page, Streaming Reports will be highlighted in green and show status as Running.
- 4. Can I stop a streaming search?
A streaming search can be stopped at any time by selecting Stop Report from the Actions pulldown on the My Reports page or on the page of the report itself.
- 5. I get a message that I have to archive or delete a report before creating a new one, why?
Your profile allows you to have a certain number of reports. You will get this message if you’ve reached your limit and are trying to create a new report. You can delete or archive one or more of your existing reports to get around this. Note that the number of archived reports is also limited – Check the My Profile page to review your limits. Different account types have different report limits. Contact us if you are interested in upgrading your account.
- 6. What does it mean if a report’s status shows as edited?
This means that you have applied some filters (or excluded some posts). Once a report has been filtered, use the Update statistics button to refresh the Basics Statistics calculations to reflect the selected data. Similarly, you can use the Update analytics button to refresh any of the Advanced Analytics. The original full dataset can easily be retrieved using Undo All Edits from the Actions pulldown.
- 7. My report says it is complete even before the timeout duration. Why?
A report is considered complete when the number of posts collected reaches the Maximum Posts per Report limit (which can be found on your My Profile page).
- 8. My report stopped with a timeout notification even before it reached the maximum posts per report. Why?
A search is considered timed out when the search has been executing for the duration as defined by the Report Timeout period specified on your My Profile page. At this point the search will timeout even if the post count in the report is less that the maximum allowable tweets per report.
- 9. How do I share a report with someone else?
You can share a report with anyone using the Share/Unshare feature which can be accessed from the Actions pulldown. Both streaming and completed reports can be shared. To share a report, enter the e-mail address of the person with whom you want to share the report. That person will receive an e-mail informing them that a report has been shared with them. If the person does not have a Scraawl account, he/she will have to register with Scraawl to see the report.
- 10. Can I stop sharing a report?
Yes, if you are the owner of the report, you can revoke access to a particular recipient or all recipients of a shared report. To revoke access, select Share/Unshare from the Actions pulldown and then select Revoke Access for individual users. The Revoke All button can be used to revoke access to all users.
- 11. Where can I see a list of reports that have been shared with or by me?
All shared reports can be seen in the My Folders section of the My Reports page. Shared Reports includes reports you have shared with others. Reports Shared With Me includes reports others have shared with you.
- 12. I shared a report with a user and they cannot see the raw data or run any analytics. Why?
Only the owner of a report can see the raw data and run analytics on a report. All viewers of a shared report have read-only access – they will see any filters you have applied and any analytics you have run.
- 13. What are case reports?
You can bookmark posts from any report (or from multiple reports) and export them to a Case Report. Case Reports then behave like any other report – you can see Basic Statistics, Advanced Analytics, and Raw Data.
- 1. What are basic statistics and how are the computed?
Once posts that match your search criteria are collected, Scraawl computes Basic Statistic related to top users, words, hashtags, mentions, URLs, retweets, languages, and locations. The top 50 for each of these categories are shown, with each element acting as an interactive drill-down for data exploration, and an option to filter and exclude posts associated with selected elements. For historic data (collected using Last 30 days or Recent), basic statistics are computed once all the posts that match the search criteria are retrieved. For streaming searches the statistics are updated every 2minutes. Note that only those basic statistics that are relevant to the data feed are computed.
- 2. Why do different feeds have different sets of basic statistics?
Since not all statistics are relevant to all types of feeds, only those that are relevant are calculated and displayed.
- 3. How can I use the Basic Statistics to explore and manipulate my data?
Each element in any of the Basic Statistics (e.g., Top Users, Top Words, etc.) can be used as an interactive drill-down to see the posts associated with the element. This can be done from the elements displayed in the Basic Statistics dashboard or from the full list of elements displayed when the Details button is clicked. Click the Filter button on the Details page to select individual elements, and then click the Exclude selected button to hide the posts associated with the selected elements. Use Undo All Edits from the Actions menu to undo any applied filters and get back to your full data set.
- 4. Why am I able to see some user profiles in Scraawl and for others I am redirected to the social media feed?
Scraawl only collects user profiles for the top 50 users in the report. For profiles of the other users (e.g., those mentioned in a post), Scraawl redirects you to the social media site to view the user profile.
- 5. What is the difference between geo-coded, geo-profiled and geo-referenced posts?
Geographic data is associated with posts in three ways: (1) If the user has location services turned on, the post is geo-coded using GPS coordinates. (2) If the user has a geographic location specified in his/her profile, the post is geo-profiled. (3) If the user mentions a geographic location in the body of the post, the post is geo-referenced. Given these definitions, it is possible for a post to be associated with three different locations, e.g., a user from Washington DC tweets about upcoming trip to Paris while visiting friends in Pittsburgh Pennsylvania.
- 1. What advanced analytics does Scraawl offer?
Scraawl offers a wide range of Advanced Analytics including geo-spatial analytics, social network analytics, content/text analytics, and image analytics. Please visit https://www.scraawl.com/plans#plans for a full list of available analytics
- 2. Are all advanced analytics available for all social media feeds?
No. Advanced Analytics vary by feed type, and depend in-part on the data that is available from the social media feed. Only those Advanced Analytics relevant to a particular feed are shown in the advanced analytics tab of the report.
- 3. What is the Heat Map?
The Heat Map provides a graphical representation of the density of posts across geographic locations (derived from geo-coded, geo-referenced, and geo-profiled information). Scraawl provides zoom in and out capability and the ability to toggle to the Location Map (a Basic Statistic) – here you can zoom to show the individual posts associated with locations.
- 4. How are influential users and hashtags computed?
Influence Discovery uses a ranking approach to compute normalized scores that represent the influence of users and hashtags in the social interaction graph. The scores of the top 10 most influential users/hashtags and impacts ratios (which represent the relative importance of the contributions of neighbors to the influence scores of a particular user/hashtag) are shown.
- 5. How are communities determined?
Community Detection uses a graph-theoretic approach to partition the social interaction graph into communities based on the level of interaction between nodes (users and hashtags). Scraawl provides community statistics including the number of communities, average community size, and maximum community size. Details of the top 10 communities and the most connected users/hashtags in these communities are shown.
- 6. How is the sentiment of a post computed?
Sentiment Analysis uses a machine learning-based approach that scores each record based on textual and structural features and then classifies them as positive, negative, or neutral. Classification accuracy is in the 75-80% range on average and may vary depending on the context of the conversations. Misclassifications can occur. Top posts representative of positive and negative sentiments are shown.
- 7. How is topic modeling performed?
Topic Modeling uses a probabilistic model to discover patterns of word use within and across tweets. The model uses this information to identify up to eight abstract “topics” that occur in the collection. For each of the eight topics, a probabilistic score that represent the likelihood of the topic, and up to 15 top words within that topic are shown.
- 8. Why do I see 2-3 topics on some reports and more on others?
The number of topics shown is a function of the data that is collected. If your search criteria were broad, your data is likely to have more topics than if you had used a more focused set of search criteria.
- 9. What is the media gallery?
Media Gallery collects images and videos (You Tube, Vine, and Vimeo) contained in the posts, sorts them by frequency, and presents them in a visual gallery. Simply click any image to view more details. The media type can be filtered by a particular category using the Filter by Media Type pulldown.
- 10. How does Named Entity Recognition work?
Named Entity Recognition uses a statistical matching approach to identify named entities by applying fast search with various large-scale gazetteers. Named entities recognized by Scraawl include persons, locations, and organizations. Scraawl shows the top 50 named entities with their types, entity counts, user counts, and percentages.
- 11. What is Bot Detection?
Bot Detection uses various statistical, temporal, and textual features that are detected in social media posts and historical user profiles to distinguish potential bots from human users. Scraawl assigns a bot score to each user and then displays the top users with the most representative bot behavior. Using the Filter function, you can exclude posts associated with identified Bots from your report.
- 12. What is the difference between a social graph and a friendship graph?
Using the posts collected in your report, Scraawl constructs a Social Graph in which the nodes are the users and hashtags, and the connections are the interactions between them (e.g., retweet, use of a hashtag or mention of a user, etc.). A Friendship Graph on the other-hand can be created for any user (even users not represented in your report) and shows up to 200 friends and followers of the specified users. There are buttons to generate friendship graphs from the top users or top mentions from your report, or you can manually enter users.
- 13. In the Social Metrics, how are reach, engagement, and potential impressions defined?
Scraawl uses the following definitions for its social metrics. Engagement is the sum of all replies, retweets, mentions, and likes of brand’s posts over a reporting period. It is a reflection of the number of times a user interacted with the brand. A brand’s Reach is the sum of the followers of all unique users who mentioned or retweeted the brand during the reporting period, plus the number of followers of the brand over the reporting period. Potential Impressions is the sum of the reach of all posts mentioning or retweeting the brand over the reporting period. Potential Impressions is an estimate of the number of times a post that mentions the brand could show up in a user’s social media feed. When the reporting period is more than a day, the maximum follower count over the reporting period is used in the calculation.
- 14. Why don’t my reach, engagement, and potential impressions numbers match up with those on Twitter analytics?
Twitter uses slightly different definitions to calculate social metrics. In addition to including replies, retweets, and mentions, Twitter analytics includes hashtag clicks, link clicks, avatar clicks, username clicks, Tweet expansions, and follows. Similarly, Twitter analytics uses “actual impressions” as opposed to potential impressions. The definition used by Twitter’s new engagement API identifies an impression as “anytime a user sees your Tweet.”
- 1. What is raw data?
Raw Data shows all the posts in your report. These are displayed in chronological order with the most recent tweet displayed first.
- 2. How can I search and filter my data?
There are many ways to filter your data in Scraawl. (1) You can use the Timeline sliders on the Basic Statistics dashboard to focus on posts during a particular time period. (2) You can select and exclude posts associated with elements from any of the “Top” lists in Basic Statistics. (3) After drilling down on a particular element in a “Top” list, you can use the View All button to see the post associated with the selected element. (4) You can use the geo-fencing feature on the Location Map to focus in on posts from a particular region. (5) You can search and filter the Raw Data.
- 3. Can I search and filter from my raw data?
Yes. You can use a number of search operators such as word-match, time, or username. You can also use Scraawl’s Sentiment, Community, and Topic analytics for search. A complete list of supported search expressions can be found by clicking on the operators link in the search tip under the Search box in Raw Data. Once you have found the desired posts using the search operators, you can choose to keep or exclude the posts using Keep ONLY matching or Exclude. You can also use the Bookmark feature and then Export Bookmarked posts (from Actions menu) to a Case Report.
- 4. Do I lose all the data that was excluded from my report?
No, the data is not lost. To revert to the original dataset, select Undo All Edits from the Actions pulldown.
- 5. What does bookmarking do?
Once you have searched and filtered your data, you may want to bookmark select posts for future reference. The Bookmark menu provides options to bookmark or un-bookmark selected posts. You can Export Bookmarked posts (from Actions menu) to a Case Report. Case Reports then behave like any other report – you can view Basic Statistics, Advanced Analytics, and Raw Data.
- 1. What are the pricing plans for a Scraawl Professional, Premium, or Enterprise plan?
Please Contact us for pricing information.