Merging Datasets

For the DHS surveys, The DHS Program distributes separately Household, Household Member, Women, Children under five, Men, and Couples files in flat or hierarchical formats. Care has been taken to include the variables that are deemed important for each of these files. For example, variables for household characteristics are included in the women, men, and children's files.

However, there are instances when researchers have to merge or combine different files to obtain the variables that meet their analysis needs. This section discusses the variables and mechanisms that can be used to accomplish that task.

On this page

File Relationship Types

It is important to mention again that matching files is only necessary when variables required for the analysis are not present in the distributed file but are present in any other file. When merging data files its important to know the type of relationship that exists between the files to be merged as well as the type of output file desired (unit of analysis).  There are two types of relationships: The first is that of one entity related to many other entities [1 : 0-N] and the second is that of one entity related to just one other entity [1 : 0-1].

An example of a relationship of one to many entities can be found between households and women or men. There may exist zero or several women or men questionnaires for each household. An example of a relationship of one to one can be found in the relation existent between women and men. In a monogamous country, there may be zero or one man questionnaire for each woman if she is currently married.

Unique Case Identifiers

One of the advantages of processing complex surveys with CSPro, a software capable of handling hierarchical files, is that it allows to tightly control the case identifiers. DHS guarantees that their files can be matched seamlessly whenever a relationship is possible. To properly manipulate the files it is necessary to know what the variables or fields that identify the cases are. The following reference table shows those fields.

Unique Case Identifiers for Data Files

Matching Variables

When merging files it is generally easier to use the original variables rather than the ID variables. For example, it is not possible to merge the household and women’s files using HHID and CASEID because CASEID has three extra characters identifying the women’s line number. The files can be more easily merged using variables HV001 with V001 and HV002 with V002.

The following reference table shows the variables required to match different files. In the rows, the base files are listed. In the columns, the secondary files along with the variables to be used as keys or matching variables are listed. In the cells intersecting the rows and columns, variables from the base files used to match the secondary file are listed.

Matching Variables

This table shows that household variables can be appended to women, men and children. Women variables can be appended to their children. They also can be appended to men, to create couples. Notice that there is no relationship between children and men because children come from the birth history, which is asked to women.

With software that requires the variables that are used for merging to have the same name in both files it will be necessary to either rename or to create copies of the matching variables in one file to match the names in the other file being used.  For example, to match the household data to the women's data, first rename HV001 to V001 and HV002 to V002, or create a copy of HV001 in V001 and a copy of HV002 in V002 in the household data before merging.

Steps for Merging Datasets

All statistical packages (SPSS, SAS, STATA) have commands that allow merging files, but regardless of the package the following steps are necessary:

1.  Determine the common identifiers (identification variables).
2.  Sort both data files by the identification variables.
3.  Determine the base (primary) file. The base file establishes the unit of analysis.

  • Normally, when the relationship is that of one to many [1:0-N], the base file is the one with the many entities. For example, if merging data from households and women, the base file should be the women’s file. The reason is that you may want to assign to every woman the characteristics of her household. If the match is done the other way around, once the program matches the first woman it will not look for another woman or it will give an error for finding duplicate cases. In the case of matching women and children, the base file should be the children’s file. That way, mothers’ characteristics are assigned to children.
  • If the relationship is that of one to one [1:0-1], the base file is normally the one with the least number of cases. In DHS, men's questionnaires are only applied to a sub-sample of households. This means that not all currently married women have a match with a men's questionnaire. In this case, the base file should be the men's questionnaire and the resulting file (unit of analysis) will be the Couples file.

4.  Finally, using the right commands depending on the software to be used, the files will be merged.

Download Datasets

The DHS Program is authorized to distribute, at no cost, unrestricted survey data files for legitimate academic research. Registration is required for access to data.

Guide to Using Datasets


Debugging Information
ColdFusion Server Standard 2018,0,19,330149
Template /data/Merging-Datasets.cfm
Time Stamp 13-Oct-24 05:14 AM
Locale English (US)
User Agent CCBot/2.0 (https://commoncrawl.org/faq/)
Remote IP 10.0.2.225
Host Name 10.0.2.225


Execution Time

Total Time Avg Time Count Template
1059 ms 26 ms 40 C:/inetpub/wwwroot/commonspot/utilities/ct-render-element.cfm
1011 ms 25 ms 40 C:/inetpub/wwwroot/commonspot/utilities/ct-render-element-core.cfm
906 ms 906 ms 1 C:/inetpub/wwwroot/commonspot/master.cfm
906 ms 906 ms 1 C:/inetpub/wwwroot/dhs/data/Merging-Datasets.cfm
844 ms 844 ms 1 C:/inetpub/wwwroot/commonspot/utilities/cached-page-render.cfm
594 ms 594 ms 1 C:/inetpub/wwwroot/commonspot/master-render.cfm
594 ms 594 ms 1 C:/inetpub/wwwroot/commonspot/render-page-meat.cfm
594 ms 594 ms 1 C:/inetpub/wwwroot/commonspot/render-page.cfm
594 ms 594 ms 1 C:/inetpub/wwwroot/commonspot/uncached-master.cfm
578 ms 53 ms 11 C:/inetpub/wwwroot/commonspot/utilities/ct-render-named-element.cfm
578 ms 578 ms 1 C:/inetpub/wwwroot/dhs/templates/template-basepage.cfm
250 ms 250 ms 1 C:/inetpub/wwwroot/commonspot/utilities/update-page-cache-status.cfm
217 ms 217 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c1378-l70-t51-dAny.read
47 ms 47 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19153-l70-t51-dAny.read
47 ms 47 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19154-l70-t51-dAny.read
46 ms 46 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c1433-l70-t51-dAny.read
32 ms 32 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19152-l70-t51-dAny.read
32 ms 32 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19155-l70-t51-dAny.read
31 ms 31 ms 1 C:/inetpub/wwwroot/commonspot/set-page-vars.cfm
31 ms 31 ms 1 C:/inetpub/wwwroot/commonspot/site-application.cfm
31 ms 31 ms 1 C:/inetpub/wwwroot/commonspot/startup/site-application-meat.cfm
31 ms 31 ms 1 C:/inetpub/wwwroot/dhs/data/Application.cfm
16 ms 16 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19174-l70-t51-dAny.read
16 ms 16 ms 1 C:/inetpub/wwwroot/commonspot/render-head.cfm
16 ms 16 ms 1 C:/inetpub/wwwroot/commonspot/render-metatags.cfm
16 ms 16 ms 1 C:/inetpub/wwwroot/commonspot/startup/core-application-meat.cfm
16 ms 16 ms 1 C:/inetpub/wwwroot/commonspot/utilities/verify-stub-data.cfm
15 ms 15 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c49731-l70-t27356-dAny.read
15 ms 15 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c8045-l70-t51-dAny.read
15 ms 15 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c8048-l70-t51-dAny.read
15 ms 15 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c8050-l70-t51-dAny.read
15 ms 15 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c8052-l70-t51-dAny.read
15 ms 15 ms 1 C:/inetpub/wwwroot/commonspot/non-dashboard-include.cfm
0 ms 0 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c1432-l70-t51-dAny.read
0 ms 0 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19169-l70-t51-dAny.read
0 ms 0 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19172-l70-t51-dAny.read
0 ms 0 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c19177-l70-t51-dAny.read
0 ms 0 ms 1 C:/commonspot-data/customers/commonspot-users/sites/commonspot-site-dhs/mapped/cache/5/p13551-c49703-l70-t27356-dAny.read
0 ms 0 ms 1 C:/inetpub/wwwroot/ADF/core/load_site_adf.cfm
0 ms 0 ms 2 C:/inetpub/wwwroot/commonspot/controls/ct-include-once.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/lview-contribute-mode-redirect-check.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/pagemode/pagemodeui.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/render-body-tag.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/render-foot.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/render-tracking-code.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/security/security-page.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/browser-detect-methods.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/build-request-params.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/handle-head-request.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/handle-request-timeout.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/init-customer-scope.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/init-server-scope.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/session-first-global.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/startup/session-first-site.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/upfront-ghost-queries.cfm
0 ms 0 ms 17 C:/inetpub/wwwroot/commonspot/utilities/add-resource-request.cfm
0 ms 0 ms 6 C:/inetpub/wwwroot/commonspot/utilities/add-unregistered-resource-request.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/append-to-resource-group.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/build-user-struct.cfm
0 ms 0 ms 3 C:/inetpub/wwwroot/commonspot/utilities/cp-cfheader.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/cp-cfmail-request-queue.cfm
0 ms 0 ms 2 C:/inetpub/wwwroot/commonspot/utilities/define-upfront-vars.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/flush-cache-db-queue.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/handle-in-list.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/load-template-properties.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/newwindow-js-meat.cfm
0 ms 0 ms 2 C:/inetpub/wwwroot/commonspot/utilities/newwindow-js.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/commonspot/utilities/nocache-headers.cfm
0 ms 0 ms 2 C:/inetpub/wwwroot/commonspot/utilities/validate-date-string.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/dhs/custom-application.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/dhs/custom-search/inc-custom-application-search-vars.cfm
0 ms 0 ms 1 C:/inetpub/wwwroot/dhs/templates/template-basepage.head
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc | DBQueue_Count() ] from C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc
0 ms 0 ms 3 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc | GetPageCacheStatus(1, 1, 0, 0) ] from C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc
0 ms 0 ms 2 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc | GetPageCacheStatus(13551, 5, 2352, 0) ] from C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc
0 ms 0 ms 5 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc | GetPageCacheStatus(2352, 5, 2, 0) ] from C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc | UpdateStatus([complex value], [complex value], 5, 13551, 2352, 0, 0, 90) ] from C:/inetpub/wwwroot/commonspot/components/cache/cache-status.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/custom-module-cache.cfc | getCustomAppPath(5) ] from C:/inetpub/wwwroot/commonspot/components/cache/custom-module-cache.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/custom-module-cache.cfc | getCustomModulePath(post-page-render, 5) ] from C:/inetpub/wwwroot/commonspot/components/cache/custom-module-cache.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/item-security-cache.cfc | GetEntry(13551) ] from C:/inetpub/wwwroot/commonspot/components/cache/item-security-cache.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/rewrite-rules-cache.cfc | getRewriteSettings(5) ] from C:/inetpub/wwwroot/commonspot/components/cache/rewrite-rules-cache.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/subsite-cache-manager.cfc | getLatest() ] from C:/inetpub/wwwroot/commonspot/components/cache/subsite-cache-manager.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/subsite-cache-manager.cfc | getSecurityPageIDMap([complex value]) ] from C:/inetpub/wwwroot/commonspot/components/cache/subsite-cache-manager.cfc
0 ms 0 ms 2 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/template-cache.cfc | GetTemplatePageData(1) ] from C:/inetpub/wwwroot/commonspot/components/cache/template-cache.cfc
0 ms 0 ms 3 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/template-cache.cfc | GetTemplatePageData(2352) ] from C:/inetpub/wwwroot/commonspot/components/cache/template-cache.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/cache/template-cache.cfc | LoadTemplateProperties(template-Data-Template.cfm, 2352, 5) ] from C:/inetpub/wwwroot/commonspot/components/cache/template-cache.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/custom-application-framework/handle-applications.cfc | executeFunction(handleRequestStart) ] from C:/inetpub/wwwroot/commonspot/components/custom-application-framework/handle-applications.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/engine/ACF/utilities.cfc | checkFileExists(C:/inetpub/wwwroot/dhs/templates/template-basepage.cfm, 0, false) ] from C:/inetpub/wwwroot/commonspot/components/engine/ACF/utilities.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/commonspot-context.cfc | getDSN(site) ] from C:/inetpub/wwwroot/commonspot/components/util/commonspot-context.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent('head' request check) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent('site' Remote Requests processed) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent('user' Remote Requests processed) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(CGI variable processing) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(New (global) session initialized) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(Request object updates) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(Request.Params initialized) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(RequestTimeout check) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(Server-level remote requests checked) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(Subsite context updated (ID=5)) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(authoring suspended check) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(basic setup) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(check for server property changes) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(core cleanup) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(core initialization) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(core variables) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(custom-application.cfm) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(customerScope object initialized) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(handleRequestStart) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(init-server-scope loaded) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(lock checks/updates) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(site environment initialization) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(site session check) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(subsite context refreshed) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(user object created) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(user session initialized) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(wait for lock: CommonSpot_Server_Scope (read)) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | addEvent(wait for lock: CommonSpot_Site1_Core (exclusive)) ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc | init() ] from C:/inetpub/wwwroot/commonspot/components/util/debug-timing.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/object-factory.cfc | getObject(Keywords) ] from C:/inetpub/wwwroot/commonspot/components/util/object-factory.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/object-factory.cfc | getObject(LiveBookmarks) ] from C:/inetpub/wwwroot/commonspot/components/util/object-factory.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/components/util/visitor-context-rule-actions.cfc | onPageVisit(13551, 5) ] from C:/inetpub/wwwroot/commonspot/components/util/visitor-context-rule-actions.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/public_api/keywords.cfc | appendEnforced(subsiteIDOrURL = , keywordList = ) ] from C:/inetpub/wwwroot/commonspot/public_api/keywords.cfc
0 ms 0 ms 1 CFC[ C:/inetpub/wwwroot/commonspot/public_api/livebookmarks.cfc | getTags(13551) ] from C:/inetpub/wwwroot/commonspot/public_api/livebookmarks.cfc
0 ms  STARTUP, PARSING, COMPILING, LOADING, & SHUTDOWN
937 ms  TOTAL EXECUTION TIME
red = over 250 ms average execution time


SQL Queries

pendingRequests (Datasource=commonspot-sites, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\udf\remote.cfm @ 05:14:30.030
				SELECT params,RequestSequenceID
				  FROM ServerRemoteRequests
				 WHERE DestServerID = ?
					AND RequestMode = 3
			 ORDER BY RequestSequenceID
			
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1

pendingRequests (Datasource=commonspot-sites, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\udf\remote.cfm @ 05:14:30.030
			SELECT *
			  FROM ServerRemoteRequests
			 WHERE DestServerID = ? 
				AND RequestMode IN (0,2)
		
		 ORDER BY RequestSequenceID, SourceServerID
		
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1

get (Datasource=dhs_legacy_live, Time=0ms, Records=217) in C:\inetpub\wwwroot\dhs\custom-application.cfm @ 05:14:30.030
    	SELECT lang_text_var, lang_text_en
        FROM dataset_lang_dictionary
    
pendingRequests (Datasource=commonspot-users, Time=15ms, Records=0) in C:\inetpub\wwwroot\commonspot\udf\remote.cfm @ 05:14:30.030
				SELECT params,RequestSequenceID
				  FROM UsersRemoteRequests
				 WHERE DestServerID = ?
					AND RequestMode = 3
			 ORDER BY RequestSequenceID
			
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1

pendingRequests (Datasource=commonspot-users, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\udf\remote.cfm @ 05:14:30.030
			SELECT *
			  FROM UsersRemoteRequests
			 WHERE DestServerID = ? 
				AND RequestMode IN (0,2)
		
		 ORDER BY RequestSequenceID, SourceServerID
		
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1

pendingRequests (Datasource=commonspot-site-dhs, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\udf\remote.cfm @ 05:14:30.030
				SELECT params,RequestSequenceID
				  FROM RemoteRequests
				 WHERE DestServerID = ?
					AND RequestMode = 3
			 ORDER BY RequestSequenceID
			
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1

pendingRequests (Datasource=commonspot-site-dhs, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\udf\remote.cfm @ 05:14:30.030
			SELECT *
			  FROM RemoteRequests
			 WHERE DestServerID = ? 
				AND RequestMode IN (0,2)
		
		 ORDER BY RequestSequenceID, SourceServerID
		
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1

CacheInfo (Datasource=commonspot-site-dhs, Time=0ms, Records=41) in C:\inetpub\wwwroot\commonspot\components\cache\cache-status.cfc @ 05:14:30.030
			SELECT *
			  FROM ElementInstance
			 WHERE SubsiteID=?
				AND PageID=?
				AND IsWIP=? 
				AND ServerID=? 
		 ORDER BY ControlID DESC,CacheLevel
		
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 5
Parameter #2(CF_SQL_INTEGER) = 13551
Parameter #3(CF_SQL_INTEGER) = 0
Parameter #4(CF_SQL_INTEGER) = 1

PagePermissions (Datasource=commonspot-site-dhs, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\components\cache\item-security-cache.cfc @ 05:14:30.030
			SELECT *
			  FROM ItemSecurity
			 WHERE PageID = ?
				AND ApplyTo = 0 
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 13551

SelectedCustomRenderElements (Datasource=commonspot-site-dhs, Time=31ms, Records=2603) in C:\inetpub\wwwroot\commonspot\set-page-vars.cfm @ 05:14:30.030
		SELECT dcr.*
		  FROM Data_Custom_Render dcr, CustomElementModules cem
		 WHERE (dcr.PageID IN (?,?,?,?)) 
			AND dcr.VersionState=?
			AND (dcr.ModuleID = cem.ID OR dcr.ModuleID <= 0)
	 ORDER BY dcr.ControlID, dcr.PageID DESC, dcr.VersionID DESC
	
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 1
Parameter #2(CF_SQL_INTEGER) = 2
Parameter #3(CF_SQL_INTEGER) = 13551
Parameter #4(CF_SQL_INTEGER) = 2352
Parameter #5(CF_SQL_INTEGER) = 2

Request.PageData.PageParams (Datasource=commonspot-site-dhs, Time=0ms, Records=1) in C:\inetpub\wwwroot\commonspot\render-page-meat.cfm @ 05:14:30.030
			SELECT *
			  FROM Param_Page
			 WHERE (PageID=13551 OR (PageID IN (2352,2,1) AND (VersionState = 2)))
			   AND VersionState=2
			 ORDER BY PageID DESC
		
qry (Datasource=commonspot-site-dhs, Time=0ms, Records=1) in C:\inetpub\wwwroot\commonspot\udf\validation\core.cfm @ 05:14:30.030
					SELECT SubsiteID
					  FROM SitePages
					 WHERE ID = ? 
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 13551

testQuery (Datasource=commonspot-site-dhs, Time=0ms, Records=1) in C:\inetpub\wwwroot\commonspot\udf\validation\generated-validators.cfm @ 05:14:30.030
		SELECT ID
		  FROM SitePages
		 WHERE ID = ?
			AND (PageType IN (0,1) AND Uploaded=0)
	
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 13551

qry (Datasource=commonspot-site-dhs, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\commands\livebookmarks.cfc @ 05:14:30.030
		SELECT Data_SeeAlso.ID, SubSites.SubSiteURL, SitePages.filename as pagename,
				 XMLPublications.name as feedname, XMLPublicationFormat.name as feedformat,
				 XMLPublications.description,
				 CASE
					 	WHEN XMLPublicationFormat.IsSyndication = 0 THEN 0
						ELSE 1
				 END AS IsSyndicationFeed
		  FROM Data_SeeAlso, XMLPublications, XMLPublicationFormat, SitePages, SubSites
		 WHERE Data_SeeAlso.PageID = ?
		 	AND Data_SeeAlso.Action = ?
		 	AND Data_SeeAlso.ItemID = XMLPublicationFormat.XMLPublicationFormatID
		 	AND Data_SeeAlso.TargetPageID = XMLPublications.XMLPublicationID
		 	AND XMLPublications.XMLPublicationFormatID = XMLPublicationFormat.XMLPublicationFormatID
		 	AND XMLPublications.PageID = SitePages.ID
		 	AND SitePages.SubSiteID = SubSites.ID
	
Query Parameter Value(s) -
Parameter #1(CF_SQL_INTEGER) = 13551
Parameter #2(CF_SQL_INTEGER) = 11

Request.GetGhost (Datasource=commonspot-site-dhs, Time=0ms, Records=0) in C:\inetpub\wwwroot\commonspot\upfront-ghost-queries.cfm @ 05:14:30.030
	SELECT *
	  FROM Data_Ghost_Common
	 WHERE (PageID=13551 OR (PageID IN (2352,2,1) AND (VersionState = 2)))
	ORDER BY ControlID, PageID DESC


Scope Variables

Application Variables:
activesubsites=1,2,5,6,8,17,18,19,20,21,22,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58
adf=Struct (89)
adfscheduler=Struct (0)
applicationname=site1
assocpubdocs=Struct (4)
blogcache=Struct (4)
cachedimages=Struct (32)
cacheinfocache=Struct (53)
confidentiality=Array (5)
controlinstance_toplevel_cache=Struct (126)
covid_articlecount=10
covid_newsarticlecount=49
covid_pressreleasecount=0
covid_pubcount=3
cs_elementcache=Struct (10)
cs_resourcesmissing=Struct (0)
cs_rewriterulescache=Struct (21)
cs_subsitecachemanager=Struct (28)
customerinfo=Complex type
customerscope=Struct (21)
custommodulecache=Struct (21)
defaultconfidentiality=2
dhspagesyncdata=Struct (1)
itemsecuritycache=Struct (31)
languagenames=Struct (51)
languages=Struct (51)
lastknownchange=Struct (18)
lastupdate=Struct (14)
metadatacache=Struct (4)
pendingstubrequests=Struct (0)
rsscache=Struct (2)
search_archive_next_clean=2024-10-13 19:08:16
serverstatus=Struct (1)
site=Struct (74)
sitescope=Struct (9)
styleids=Struct (248)
stylenames=Struct (248)
subsitecache=Struct (46)
subsitecachebysecuritypageid=Struct (46)
templatecache=Struct (28)
templatedefaultsecuritycache=Struct (60)
templateenforcedsecuritycache=Struct (60)
treecache=Struct (25)
twittercache=Struct (2)
typefactory=Complex type
youtubecache=Struct (3)
CGI Variables:
AUTH_PASSWORD=
AUTH_TYPE=
AUTH_USER=
CERT_COOKIE=
CERT_FLAGS=
CERT_ISSUER=
CERT_KEYSIZE=
CERT_SECRETKEYSIZE=
CERT_SERIALNUMBER=
CERT_SERVER_ISSUER=
CERT_SERVER_SUBJECT=
CERT_SUBJECT=
CF_TEMPLATE_PATH=C:\inetpub\wwwroot\dhs\data\Merging-Datasets.cfm
CONTENT_LENGTH=0
CONTENT_TYPE=
CONTEXT_PATH=
GATEWAY_INTERFACE=CGI/1.1
HTTPS=off
HTTPS_KEYSIZE=
HTTPS_SECRETKEYSIZE=
HTTPS_SERVER_ISSUER=
HTTPS_SERVER_SUBJECT=
HTTP_ACCEPT=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
HTTP_ACCEPT_ENCODING=br,gzip
HTTP_ACCEPT_LANGUAGE=en-US,en;q=0.5
HTTP_CONNECTION=
HTTP_COOKIE=
HTTP_HOST=preview.dhsprogram.com
HTTP_REFERER=
HTTP_URL=/data/Merging-Datasets.cfm
HTTP_USER_AGENT=CCBot/2.0 (https://commoncrawl.org/faq/)
LOCAL_ADDR=10.0.0.111
PATH_INFO=
PATH_TRANSLATED=C:\inetpub\wwwroot\dhs\data\Merging-Datasets.cfm
QUERY_STRING=
REMOTE_ADDR=10.0.2.225
REMOTE_HOST=10.0.2.225
REMOTE_USER=
REQUEST_METHOD=GET
SCRIPT_NAME=/data/Merging-Datasets.cfm
SERVER_NAME=preview.dhsprogram.com
SERVER_PORT=80
SERVER_PORT_SECURE=0
SERVER_PROTOCOL=HTTP/1.1
SERVER_SOFTWARE=Microsoft-IIS/10.0
WEB_SERVER_API=
Cookie Variables:
CSRFTOKEN=12727BE5F0903ED268EB55BF256AA6B26C9A03BF
Request Parameters:
anonnoreadelements=
applockname=CS_App_Site1_1
archiveemail=archive@dhsprogram.com
assetsdir=/assets/
author_approve_whereclause=(VersionState = 2)
authormode=0
authorok=1
blupfront=
browser=Struct (13)
browserallincluded=1
cachefilesused=38
cachestatus=Complex type
cfflushcount=0
cgivars=Struct (49)
cloudfrontkeypairid=K3LSHNFSZFMIUC
cloudfronturl=d1vyaiefsqy4pf
constants=Complex type
cors.isCorsRequest=NO
cp=Struct (123)
cs_includedobjects=nwjs
cs_init_timings=Struct (23)
cs_isdashboardcmd=0
cs_request_start_memory=1593835520
cs_runningdashboardcmdcode=0
csrftoken=12727BE5F0903ED268EB55BF256AA6B26C9A03BF
customcfupfront=
customerinfo=Complex type
customhead=1
customrenderhandlerpairs=
customsearch=Struct (11)
data_ghost=Struct (0)
dbdsn=measure_db
debugstate=Struct (1)
dhspagesyncdata=Struct (1)
dhtmlmenuitemsprefetch=
disablehideformenus=0
dsource=dhs_legacy_live
editmode=0
element=Struct (42)
elementrundetail=Struct (0)
elementsrun=0
environment=Struct (5)
finalreportids=5,26,21,10,18,30,39
finalreportna=139,315,445,488,107,138,459,518
formattedtimestamp=2024-10-13 05:14:30
getghost=Query (0)
hivbold=1,3,8,9
imageupfront=
imgdir=/images/
includerootdir=/
initialsiteid=1
initticks=1728796470217
jswarnmessage=
linkdataupfront_itempos=
linkdataupfront_itemtitle=
lockid=0
mainpage=Struct (84)
master_cfm_used=1
maxperms=Complex type
modeorderbyclause=VersionID Desc
modewhereclause=(VersionState = 2)
modewhereclause_page=(VersionState = 2)
multisectionupfront=
noauthorreason=
nocacheelementtypes=
nocacheheaderincluded=1
nondashboardincludedone=1
obcountires=EG,ZM
package=Struct (0)
page=Struct (84)
pagedata=Struct (1)
pagedhtmlitems=
pagedhtmlmenus=
pageperms=Complex type
pagesync=Struct (4)
params=Struct (4)
params_formfields=
params_urlfields=
previewmode=0
readmodewhereclause=(VersionState = 2)
renderedelements=Struct (0)
renderelementdata=Struct (0)
renderfordiff=0
renderforprint=0
renderstate=Struct (73)
req_cam_callcount=1
req_inittimestamp=2024-10-13 05:14:30.201
req_sequenceid=8841
req_startticks=1728796470201
rootdir=/
rootpath=
rooturldatasetadmin=https://preview.dhsprogram.com/data/dataset_admin
samesite_value=
scheduleupfront=
serverdatasource=commonspot-sites
sessionlockname=Session_1_964ED47A4679AFE87252AE3F9D98FC99.cfusion
sessionstring=1_964ED47A4679AFE87252AE3F9D98FC99.cfusion
sicupfront=
sicupfrontparam=
site=Struct (74)
siteid=1
standardrenderhandlers=
styleids=Struct (248)
stylenames=Struct (248)
subsite=Struct (0)
subsitecache=Struct (46)
subsitecachebysecuritypageid=Struct (46)
subsiteid=5
taiupfrontparam=
tbupfront=
tbupfrontparam=
templatecachestatus=Struct (2)
templaterootdir=/
timestamp={ts '2024-10-13 05:14:30'}
trustcachestatus=1
typefactory=Complex type
udslockname=CS_Customer_commonspot-users
updatingschemas=0
user=Struct (30)
usersdatasource=commonspot-users
wanterrorsrethrown=0
warnmessage=
xmlbrowser=Struct (13)
Server Variables:
ADF=Struct (15)
COMMONSPOT=Struct (44)
EMAILALERTKEY=C2d0WfyMqe4K39HASmncTw==
coldfusion=Struct (10)
os=Struct (5)
system=Struct (2)
Session Variables:
_csrf_token=12727BE5F0903ED268EB55BF256AA6B26C9A03BF
adf=Struct (0)
authormode=0
contributemode=read
currentpageid=13551
debugmode=0
debugstate=Struct (1)
editmode=0
environment=Struct (5)
hasusertempfiles=0
language=Struct (216)
lastupdate=Struct (2)
lastuserupdate=1728796470217
lockid=0
lockobjectid=0
lockobjecttype=
locktype=
logintime=
ownedobjecttypes=
pendingapprovalpages=
pendingapprovals=
previewmode=0
requestedversioncounter=
requestedversiontimestamp=
sessionid=964ED47A4679AFE87252AE3F9D98FC99.cfusion
sessionstring=1_964ED47A4679AFE87252AE3F9D98FC99.cfusion
urltoken=CFID=9634072&CFTOKEN=1f56ef6d90f2aa0e-2AFEB5D3-9A13-8DA2-217A88B50A8D7EC2&jsessionid=964ED47A4679AFE87252AE3F9D98FC99.cfusion
usagelist=
user=Struct (30)
xmlbrowser=Struct (13)
xmlenvironment=Struct (5)
Debug Rendering Time: 16 ms